-- Logs begin at Fri 2021-08-13 03:51:52 UTC, end at Fri 2021-08-13 04:46:08 UTC. -- Aug 13 04:21:43.537688 dv-cinder-759961-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 13 04:21:43.545705 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 13 04:21:43.547688 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 13 04:21:43 2021] *** Aug 13 04:21:43.547688 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 13 04:21:43.547688 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 13 04:21:43.547688 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: nodename: dv-cinder-759961-6-iscsi Aug 13 04:21:43.547688 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: machine: x86_64 Aug 13 04:21:43.547688 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: clock source: unix Aug 13 04:21:43.547688 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: pcre jit disabled Aug 13 04:21:43.547688 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: detected number of CPU cores: 4 Aug 13 04:21:43.547688 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: current working directory: / Aug 13 04:21:43.547688 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: detected binary path: /usr/bin/uwsgi-core Aug 13 04:21:43.548380 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: your processes number limit is 47680 Aug 13 04:21:43.548380 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: your memory page size is 4096 bytes Aug 13 04:21:43.548380 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: detected max file descriptor number: 2048 Aug 13 04:21:43.548380 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: lock engine: pthread robust mutexes Aug 13 04:21:43.548380 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: thunder lock: enabled Aug 13 04:21:43.548380 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 13 04:21:43.548380 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 13 04:21:43.593776 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: Python main interpreter initialized at 0x55d51e6a89c0 Aug 13 04:21:43.593776 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: python threads support enabled Aug 13 04:21:43.593776 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: your server socket listen backlog is limited to 100 connections Aug 13 04:21:43.593776 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: your mercy for graceful operations on workers is 90 seconds Aug 13 04:21:43.594186 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: mapped 403077 bytes (393 KB) for 2 cores Aug 13 04:21:43.594264 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: *** Operational MODE: preforking *** Aug 13 04:21:43.594494 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: *** uWSGI is running in multiple interpreter mode *** Aug 13 04:21:43.594494 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: spawned uWSGI master process (pid: 93198) Aug 13 04:21:43.594699 dv-cinder-759961-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 13 04:21:43.597523 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: spawned uWSGI worker 1 (pid: 93199, cores: 1) Aug 13 04:21:43.597523 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: spawned uWSGI worker 2 (pid: 93200, cores: 1) Aug 13 04:21:43.597523 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 13 04:21:45.241158 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 13 04:21:45.241158 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: from cryptography.utils import int_from_bytes Aug 13 04:21:45.241863 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 13 04:21:45.241863 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: from cryptography.utils import int_from_bytes Aug 13 04:21:45.242638 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 13 04:21:45.242638 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: from cryptography.utils import int_from_bytes Aug 13 04:21:45.243107 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 13 04:21:45.243107 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: from cryptography.utils import int_from_bytes Aug 13 04:21:47.912313 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 13 04:21:47.912816 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 13 04:21:47.912906 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 13 04:21:47.913269 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 13 04:21:47.913367 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 13 04:21:47.913475 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 13 04:21:47.913566 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 13 04:21:47.913650 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 13 04:21:47.913872 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 13 04:21:47.913978 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.914125 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 13 04:21:47.914300 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.914513 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.914606 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.914841 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.914947 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.915162 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.915256 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.915480 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.915573 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.915806 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.915893 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.916174 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.916267 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.916559 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.916708 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.916888 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.917025 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.917222 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.917317 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.917514 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.917680 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759961-6-iscsi {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.917829 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.917919 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.918153 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759961-6-iscsi {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.918241 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.918474 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.918583 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.918784 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.918890 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.919084 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.919170 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.919402 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.919496 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.919701 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.919793 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.920020 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.920196 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.920316 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.920646 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.920813 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.920979 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.921118 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.921270 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.921449 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.921617 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.921751 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.921931 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.922092 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.922238 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.922409 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.922556 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.922722 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.922862 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.923043 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.923181 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.923352 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.923490 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.923673 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.923885 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759961-6-iscsi {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.923978 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.924198 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.924360 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759961-6-iscsi {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.924507 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.924675 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.924834 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.925004 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.925293 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.925398 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.925561 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.925723 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.925872 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.926035 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.926181 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.926343 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.926498 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.926663 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.926804 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.926982 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.927127 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.927294 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.927441 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.927619 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.927755 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.927937 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.928070 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.928252 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.928370 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.928572 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.928682 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.928870 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.929000 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.929174 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.929265 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.929502 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.929608 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.929822 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.929919 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.930097 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.930188 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.930399 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.930685 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.930685 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.930840 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.930946 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.931030 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.931264 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.931356 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.931556 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.931650 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.932421 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.932580 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.932738 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.932834 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.932914 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.932991 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.933188 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.933287 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.933526 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.933626 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.933836 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.933921 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.934140 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.934236 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.934444 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.934533 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.934746 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.934839 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.935050 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.935143 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.935350 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.935435 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.935652 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.935742 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.935957 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.936050 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.936274 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.936360 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.936576 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.936664 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.936892 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.936986 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.937197 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.937281 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.937536 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.937637 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.937841 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.937927 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.938167 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.938251 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.938477 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.938561 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.938777 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.938871 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.939092 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.939216 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.939408 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.939492 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.939712 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.939799 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.940013 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.940097 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.940318 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.940410 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.940622 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.940714 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.940929 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.941013 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.941227 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.941319 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.941498 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.941597 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.941799 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.941884 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.942099 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.942195 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.942397 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.942496 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.942702 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.942787 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.943001 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.943093 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.943302 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.943386 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.943598 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.943683 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.943901 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.943992 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.944200 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.944288 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.944504 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.944595 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.944809 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.944900 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.945109 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.945193 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.945409 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.945561 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.945736 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.945854 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.946038 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.946167 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.946343 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.946452 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.948029 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.948289 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.948381 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.948609 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.948707 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.948933 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.949033 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.949241 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.949327 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.949579 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.949682 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.949888 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.949980 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.950191 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.950280 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.950494 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.950578 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.950815 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.950912 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.951119 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.951208 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.951421 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.951505 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.951736 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.951833 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.952041 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.952125 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.952344 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.952428 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.952659 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.952752 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.952959 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.953044 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.953263 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.953349 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.953600 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.953698 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.953903 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.953987 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.954203 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.954286 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.954503 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.954589 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.954803 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.954887 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.955103 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.955186 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.955404 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.955492 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.955701 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.955785 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.956001 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.956087 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.956297 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.956383 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.956596 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.956679 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.956901 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.956992 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.957202 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.957288 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.957528 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.957629 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.957835 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.957919 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.958150 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.958237 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.958462 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.958546 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.958767 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.958930 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.959087 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:21:47.959172 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.959423 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.959506 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.959750 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.959848 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.960078 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.960164 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.960390 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.960473 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.960698 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.960789 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.961010 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.961095 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.961332 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.961419 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.961667 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.961753 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.961977 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.962062 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.962288 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.962379 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.962598 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.962690 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.962911 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.963069 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.963249 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.963456 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.963553 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.963777 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.963880 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.964095 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.964181 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.964413 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.964521 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.964722 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.964807 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.965037 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.965121 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.965362 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.965508 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.965710 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.965795 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.966016 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.966101 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.966341 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.966432 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.966653 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.966746 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.966985 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.967069 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.967307 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.967399 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.967616 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.967700 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.967938 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.968021 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.968246 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.968331 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.968557 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.968641 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.968869 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.968956 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.969181 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.969266 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.969514 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.969604 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.969825 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.969910 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.970135 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.970220 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.970448 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.970532 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.970762 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.970856 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.971067 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.971153 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.971370 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.971455 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.971675 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.971771 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.971982 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.972066 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.972282 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.972365 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.972593 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.972685 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.972900 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.972991 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.973211 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.973294 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.973563 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.973664 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.973870 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.973991 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.974181 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.974266 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.974490 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.974587 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.974794 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.974879 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.975104 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.975193 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.975412 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.975547 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.975713 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.975797 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.976027 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.976110 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.976333 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.976425 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.976637 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.976722 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.976958 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.977049 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.977261 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.977346 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.977589 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.977677 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.977906 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.977990 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.978211 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.978304 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.978520 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.978604 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.978860 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.978953 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.979218 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.979312 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.979569 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.979668 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.979875 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.979968 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.980195 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.980279 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.980509 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.980593 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.980819 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.980921 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.981138 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.981224 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.981483 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.981573 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.981804 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.981969 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.982110 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.982197 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.982423 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.982571 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.982724 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.982819 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.983029 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.983114 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.983334 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.983425 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.983641 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.983735 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.983943 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.984029 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.984247 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.984332 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.984550 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.984642 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.984853 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.984937 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.985154 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.985237 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.985483 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.985607 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.985791 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.985885 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.986094 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.986216 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.986401 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.986487 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.986704 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.986787 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.987012 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.987105 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.987316 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.987402 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.987660 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.987746 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.987973 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.988058 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.988294 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.988385 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.988617 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.988702 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.988929 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.989021 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.989244 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.989329 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.989579 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.989665 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.989895 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.989999 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.990203 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.990288 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.990514 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.990597 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.990823 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.990920 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.991135 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.991219 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.991453 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.991536 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.991762 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.991858 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.992079 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.992163 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.992385 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.992468 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.992704 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.992798 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.993010 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.993095 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.993325 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.993416 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.993657 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.993778 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.993974 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.994066 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.994844 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.994953 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.995119 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.995243 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.995432 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.995671 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.995821 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.995986 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.996123 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.996302 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.996436 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.996628 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.996757 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.996929 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.997069 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.997239 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.997374 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.997574 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.997704 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.997882 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.998012 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.998190 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.998324 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.998499 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.998626 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.998803 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.998933 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.999115 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.999249 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.999424 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.999569 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.999797 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:47.999906 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.000035 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.000124 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.000344 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.000438 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.000652 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.000748 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.000958 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.001046 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.001273 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.001367 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.001620 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.001710 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.001926 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.002013 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.002229 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.002326 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.002551 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.002638 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.002854 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.002941 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.003157 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.003254 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.003462 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.003550 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.003765 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.003854 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.004071 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.004169 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.004378 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.004465 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.004684 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.004771 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.004999 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.005095 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.005322 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.005410 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.005651 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.005750 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.005966 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.006077 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.006274 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.006363 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.006581 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.006675 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.006898 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.006987 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.007209 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.007297 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.007516 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.007603 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.007828 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.007917 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.008139 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.008227 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.008451 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.008539 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.008761 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.008855 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.009076 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.009163 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.009381 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.009486 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.009734 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.009821 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.010592 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.010684 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.010902 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.011006 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.011216 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.011312 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.011534 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.011622 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.011842 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.012157 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.012246 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.012480 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.012573 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.012794 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.013054 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.013150 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.013391 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.013505 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.013734 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.013817 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.014061 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.014180 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.014383 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.014471 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.014693 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.014787 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.014999 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.015088 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.015310 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.015396 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.015615 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.015701 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.015920 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.016023 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.016230 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.016325 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.016534 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.016622 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.016838 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.016926 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.017136 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.017221 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.017459 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.017561 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.017767 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.017861 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.018069 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.018157 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.018371 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.018468 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.018674 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.018763 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.018976 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.019062 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.019278 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.019377 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.019583 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.019668 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.019884 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.019967 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.020190 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.020297 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.020500 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.020593 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.020803 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.020901 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.021102 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.021200 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.021403 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.021521 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.021737 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.021822 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.022043 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.022144 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.022350 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.022445 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.022694 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.022782 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.023002 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.023090 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.023325 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.023410 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.023629 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.023716 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.023963 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.024052 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.024269 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.024365 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.024574 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.024661 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.024873 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.024967 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.025182 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.025277 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.025547 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.025656 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.025931 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.026018 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.026260 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.026375 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.026573 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.026675 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.026882 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.026971 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.027189 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.027318 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.027493 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.027583 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.027802 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.027891 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.028104 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.028200 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.028414 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.028501 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.028982 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.029075 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.029286 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.029374 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.029613 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.029701 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.029923 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.030020 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.030227 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.030324 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.030526 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.030614 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.030842 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.030960 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.031139 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.031228 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.031443 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.031537 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.031744 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.031841 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.032045 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.032131 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.032345 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.032437 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.032654 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.032770 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.032956 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.033044 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.033256 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.033343 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.033593 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.033696 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.033902 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.033988 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.034205 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.034295 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.034509 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.034608 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.034811 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.034899 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.035113 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.035201 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.035420 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.035508 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.035722 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.035815 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.036028 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.036116 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.036334 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.036428 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.036646 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.036740 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.036948 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.037035 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.037253 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.037340 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.037580 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.037670 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.037884 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.037971 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.038183 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.038272 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.038485 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.038574 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.038787 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.038882 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.039088 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.039175 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.039386 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.039484 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.039687 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.039781 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.039991 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.040079 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.040291 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.040386 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.040595 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.040691 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.040898 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.041049 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.041227 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.041345 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.041557 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.041656 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.041864 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.041953 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.042211 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.042298 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.042518 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.042614 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.042837 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.042930 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.043148 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.043235 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.043457 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.043553 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.043771 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.043859 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.044076 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.044202 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.044388 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.044476 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.044694 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.044780 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.044997 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.045083 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.045300 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.045395 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.045632 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.045721 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.045947 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.046033 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.046254 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.046387 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.046562 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.046650 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.046878 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.046963 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.047186 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.047274 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.047499 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.047585 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.047801 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.047887 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.048110 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.048199 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.048422 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.048521 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.048728 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.048824 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.049037 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.049125 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.049343 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.049449 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.049675 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.049774 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.049983 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.050070 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.050295 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.050409 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.050605 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.050716 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.050915 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.051035 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.051220 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.051314 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.051528 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.051632 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.051835 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.051928 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.052138 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.052230 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.052453 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.052547 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.052759 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.052853 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.053063 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.053155 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.053369 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.053485 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.053695 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.053781 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.054002 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.054097 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.054305 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.054402 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.054609 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.054728 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.054923 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.055044 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.055231 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.055357 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.055662 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.055755 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.056003 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.056098 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.056319 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.056418 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.056631 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.057248 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.057483 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.057604 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.057792 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.057926 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.058197 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.058332 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.058511 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.058659 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.058824 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.058964 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.059135 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.059278 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.059431 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.059573 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.059730 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.059881 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.060043 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.060180 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.060370 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.060483 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.060674 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.060760 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.060978 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.061063 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.061281 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.061367 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.061641 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.061727 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.061954 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.062042 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.062263 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.062349 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.062587 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.062679 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.062895 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.062981 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.063219 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.063308 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.063639 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.063725 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.063955 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.064041 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.064263 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.064367 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.064588 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.064685 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.064906 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.065001 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.065229 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.065315 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.065558 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.065647 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.065875 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.066043 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.066188 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.066274 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.066517 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.066619 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.066833 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.066939 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.067143 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.067235 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.067458 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.067550 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.067764 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.067859 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.068081 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.068167 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.068400 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.068483 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.068726 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.068827 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.069029 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.069114 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.069353 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.069469 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.069698 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.069787 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.070025 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.070111 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.070426 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.070521 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.070739 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.070840 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.071044 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.071235 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.071350 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.071427 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.071661 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.071748 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.071965 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.072059 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.072271 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.072939 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.073150 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.073245 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.073488 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.073607 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.073804 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.073908 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.074116 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.074205 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.074428 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.074518 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.074734 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.074820 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.075042 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.075120 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.075354 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.075430 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.075661 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.075750 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.075969 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.076051 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.076309 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.076400 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.076646 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.076881 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.077043 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.077266 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.077266 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.077533 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.077625 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.077713 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.077845 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.077942 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.078152 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.078241 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.078458 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.078546 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.078763 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.078859 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.079078 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.079166 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.079388 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.079477 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.079698 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.079777 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.080027 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.080103 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.080341 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.080416 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.080660 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.080750 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.081046 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.081150 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.081318 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.081534 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.081637 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.081720 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.081971 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.082059 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.082299 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.082386 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.082606 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.082695 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.082912 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.083001 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.083223 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.083311 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.083530 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.083607 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.083836 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.083911 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.084139 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.084222 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.084446 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.084529 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.084748 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.084830 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.085054 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.085138 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.085386 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.085497 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.085685 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.085781 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.085992 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.086090 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.086299 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.086481 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.086608 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.086695 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.086916 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.087053 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.087224 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.087323 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.087526 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.087621 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.087831 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.087926 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.088178 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.088281 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.088485 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.088581 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.088814 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.088909 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.089136 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.089246 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.089484 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.089580 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.089796 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.089891 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.090119 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.090211 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.090432 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.090518 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.090749 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.090836 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.091063 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.091148 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.091379 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.091464 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.091697 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.091782 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.092012 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.092096 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.092327 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.092421 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.092638 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.092725 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.092956 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.093042 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.093274 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.093371 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.093612 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.093699 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.093937 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.094165 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.094258 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.094491 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.094579 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.094804 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.095106 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.095192 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.095415 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.095510 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.095756 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.095846 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.096051 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.096145 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.096363 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.096451 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.096707 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.096806 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.097008 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.097104 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.097328 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.097417 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.097671 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.097777 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.097987 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.098073 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.098306 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.098393 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.098644 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.098731 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.098961 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.099055 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.099278 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.099364 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.099593 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.099680 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.099913 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.100009 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.100243 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.100328 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.100565 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.100658 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.100876 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.100962 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.101195 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.101282 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.101541 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.101643 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.101867 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.101963 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.102182 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.102268 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.102496 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.102590 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.102807 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.102894 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.103124 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.103210 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.103439 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.103537 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.103786 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.103879 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.104164 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.104264 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.104487 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.104593 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.104815 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.104914 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.105157 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.105243 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.105500 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.105601 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.105823 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.105916 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.106137 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.106223 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.106456 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.106551 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.106784 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.106978 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.107105 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.107518 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.107625 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.107707 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.107940 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.108035 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.108259 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.108344 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.108576 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.108670 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.108894 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.108994 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.109220 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.109320 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.109552 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.109654 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.109859 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.109946 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.110169 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.110264 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.110477 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.110570 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.110783 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.110875 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.111097 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.111194 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.111407 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.111494 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.111712 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.111801 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.112031 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.112129 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.112341 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.112427 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.112647 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.112879 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.112965 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.113233 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.113327 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.113580 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.113825 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.113910 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.114184 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.114305 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.114506 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.114608 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.114832 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.114939 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.115160 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.115258 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.115467 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.115564 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.115778 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.115874 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.116095 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.116198 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.116403 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.116499 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.116710 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.116807 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.117016 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.117104 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.117328 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.117413 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.117665 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.117764 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.117970 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.118062 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.118282 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.118367 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.118587 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.118684 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.118897 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.118982 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.119701 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.119792 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.120027 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.120201 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.120381 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.120463 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.120634 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.120751 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.120941 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.121061 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.121245 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.121369 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.121576 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.121709 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.121883 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.122019 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.122197 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.122326 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.122499 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.122637 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.122810 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.122945 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.123115 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.123261 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.123426 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.123568 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.123730 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.123883 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.124036 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.124193 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.124340 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.124512 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.124663 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.124820 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.124969 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.125135 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.125273 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.125457 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.125616 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.125787 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.125925 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.126096 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.126251 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.126403 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.126565 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.126722 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.126905 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.127038 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.127297 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.127410 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.127534 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.127665 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.127979 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.128065 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.128400 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.128545 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.128722 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.128870 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.129265 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.129420 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.129636 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.129780 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.129946 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.130105 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.130254 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.130451 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.130561 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.130795 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.130882 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.131109 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.131243 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.131421 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.131516 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.131731 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.131821 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.132061 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.132236 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.132373 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.132468 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.132698 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.132789 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.132990 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.133076 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.133299 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.133394 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.133634 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.133733 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.133945 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.134038 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.134259 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.134353 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.134572 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.134658 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.134935 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.135609 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.135742 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.135838 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.136087 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.136183 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.136428 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.136514 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.136752 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.136845 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.137062 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.137155 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.137373 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.137479 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.137720 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.137809 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.138051 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.138137 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.138365 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.138463 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.138672 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.138757 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.138999 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.139104 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.139339 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.139433 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.139658 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.139751 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.139973 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.140065 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.140326 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.140419 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.140655 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.140741 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.140991 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.141076 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.141316 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.141410 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.141656 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.141743 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.141958 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.142042 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.142263 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.142349 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.142567 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.142652 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.142875 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.142960 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.143214 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.143301 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.143546 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.143629 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.143857 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.143943 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.144173 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.144268 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.144482 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.144567 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.144797 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.144889 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.145107 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.145194 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.145417 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.145522 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.145750 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.145847 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.146062 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.146147 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.146385 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.146479 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.146696 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.146794 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.147010 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.147149 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.147317 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.147402 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.147637 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.147735 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.147947 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.148033 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.148265 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.148394 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.148568 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.148665 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.148883 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.148969 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.149194 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.149284 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.149546 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.149648 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.149855 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.149940 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.150173 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.150258 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.150503 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.150604 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.150832 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.150998 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.151135 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.151221 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.151440 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.151528 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.151761 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.151853 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.152074 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.152162 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.152382 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.152470 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.152704 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.152790 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.153010 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.153094 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.153321 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.153414 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.153656 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.154016 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.154241 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.154336 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.154549 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.154641 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.154856 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.154943 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.155169 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.155262 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.155486 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.155578 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.155788 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.155872 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.156100 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.156194 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.156419 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.156505 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.156737 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.156823 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.157045 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.157137 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.157352 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.157474 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.157704 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.157798 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.158013 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.158101 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.158325 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.158411 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.158632 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.158718 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.158939 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.159026 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.159253 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.159338 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.159563 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.159657 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.159876 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.159960 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.160191 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.160278 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.160512 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.160605 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.160830 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.160915 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.161158 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.161242 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.161488 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.161589 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.161832 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.161919 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.162160 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.162250 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.162448 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93200) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 13 04:21:48.162548 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.162811 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.163159 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.163489 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:21:48.163735 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=93199) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 13 04:21:48.186182 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_db.sqlalchemy.engines [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:21:48.188986 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG oslo_db.sqlalchemy.engines [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:21:48.265759 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.context [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ad7862d-4e34-4150-8fb8-d2ca44be5989(cell1) {{(pid=93200) load_cells /opt/stack/nova/nova/context.py:464}} Aug 13 04:21:48.267930 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.context [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ad7862d-4e34-4150-8fb8-d2ca44be5989(cell1) {{(pid=93199) load_cells /opt/stack/nova/nova/context.py:464}} Aug 13 04:21:48.270022 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:21:48.271646 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:21:48.272116 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG oslo_concurrency.lockutils [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:21:48.272458 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:21:48.273757 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG oslo_concurrency.lockutils [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:21:48.274460 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:21:48.274565 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG oslo_concurrency.lockutils [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:21:48.276557 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG oslo_concurrency.lockutils [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=93199) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:21:48.285681 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_db.sqlalchemy.engines [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:21:48.288702 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG oslo_db.sqlalchemy.engines [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:21:48.291076 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_db.sqlalchemy.engines [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:21:48.296032 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG oslo_db.sqlalchemy.engines [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:21:48.652706 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_db.sqlalchemy.engines [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93200) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:21:48.660058 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG oslo_db.sqlalchemy.engines [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=93199) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:21:49.016661 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: WARNING keystonemiddleware.auth_token [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 13 04:21:49.020010 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: WARNING keystonemiddleware.auth_token [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 13 04:21:49.023203 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: WARNING keystonemiddleware.auth_token [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 13 04:21:49.027271 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: WARNING keystonemiddleware.auth_token [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 13 04:21:49.381254 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: WARNING keystonemiddleware.auth_token [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 13 04:21:49.383852 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: WARNING keystonemiddleware.auth_token [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 13 04:21:49.387637 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: WARNING keystonemiddleware.auth_token [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 13 04:21:49.389902 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: WARNING keystonemiddleware.auth_token [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 13 04:21:49.392878 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d51e6a89c0 pid: 93200 (default app) Aug 13 04:21:49.395030 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:21:49.395123 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55d51e6a89c0 pid: 93199 (default app) Aug 13 04:21:49.396244 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-e409f031-678e-4f26-8230-e5992f1f7bb8 None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001808 Aug 13 04:21:49.396661 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 789 bytes} [Fri Aug 13 04:21:49 2021] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:12.311288 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:12.312536 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002021 Aug 13 04:23:12.312972 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 1/2] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:12 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:12.753176 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-04430847-25de-4135-9bd6-262793b37508 admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:12.782218 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-04430847-25de-4135-9bd6-262793b37508 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.462527 Aug 13 04:23:12.789531 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1292 bytes} [Fri Aug 13 04:23:12 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:23:14.979433 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:14.980478 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-546d6f51-f3e7-4c19-8eb5-b89b1eeda770 None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Aug 13 04:23:14.980905 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 2/4] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:14 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:15.047134 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-ecb4901c-1e78-4dc8-bd31-51ec11c6edba admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 256, "id": "c1", "name": "cirros256", "swap": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "disk": 1}} {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:15.064978 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:23:15.064978 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: warnings.warn(msg) Aug 13 04:23:15.095153 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-ecb4901c-1e78-4dc8-bd31-51ec11c6edba admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.106338 Aug 13 04:23:15.096083 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 3/5] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Aug 13 04:23:14 2021] POST /compute/v2.1/flavors => generated 407 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:23:15.316779 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-ed2acb6e-2834-4ce2-bbee-1a968e832c9b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:15.319779 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:23:15.319779 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: warnings.warn(msg) Aug 13 04:23:15.369744 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-ed2acb6e-2834-4ce2-bbee-1a968e832c9b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.265065 Aug 13 04:23:15.373709 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 3/6] 10.222.0.13 () {64 vars in 1336 bytes} [Fri Aug 13 04:23:15 2021] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:23:17.555302 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-ecb4901c-1e78-4dc8-bd31-51ec11c6edba admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:17.556902 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-ecb4901c-1e78-4dc8-bd31-51ec11c6edba admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002120 Aug 13 04:23:17.557592 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 4/7] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:17 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:17.668203 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-ed13c2f4-cce3-4c45-904a-13b8bfb69e8b admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 512, "swap": 0, "vcpus": 1, "name": "ds512M", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5, "id": "d1", "rxtx_factor": 1.0}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:17.686461 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-manage:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:23:17.686461 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: warnings.warn(msg) Aug 13 04:23:17.705381 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-ed13c2f4-cce3-4c45-904a-13b8bfb69e8b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.140815 Aug 13 04:23:17.706000 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 4/8] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Aug 13 04:23:17 2021] POST /compute/v2.1/flavors => generated 404 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:23:17.718144 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-dc8fc54b-00d0-46af-978a-18ee39fff4d3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:17.719608 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-flavor-extra-specs:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:23:17.719608 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: warnings.warn(msg) Aug 13 04:23:17.752992 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-dc8fc54b-00d0-46af-978a-18ee39fff4d3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.038507 Aug 13 04:23:17.753621 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 5/9] 10.222.0.13 () {64 vars in 1336 bytes} [Fri Aug 13 04:23:17 2021] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:23:19.931086 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-ed13c2f4-cce3-4c45-904a-13b8bfb69e8b admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:19.932096 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-ed13c2f4-cce3-4c45-904a-13b8bfb69e8b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Aug 13 04:23:19.932494 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 5/10] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:19.997134 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-da171d8c-5c93-4b8d-b284-864291875fb4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "disk": 10, "swap": 0, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d2", "name": "ds1G"}} {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:20.016338 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-da171d8c-5c93-4b8d-b284-864291875fb4 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.077383 Aug 13 04:23:20.017285 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 6/11] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Aug 13 04:23:19 2021] POST /compute/v2.1/flavors => generated 404 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:23:20.029400 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-14c35a16-31df-4e74-8408-9b0bec1136f7 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:20.058592 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-14c35a16-31df-4e74-8408-9b0bec1136f7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.033107 Aug 13 04:23:20.060258 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 6/12] 10.222.0.13 () {64 vars in 1336 bytes} [Fri Aug 13 04:23:20 2021] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:23:22.247809 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-da171d8c-5c93-4b8d-b284-864291875fb4 admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:22.248842 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-da171d8c-5c93-4b8d-b284-864291875fb4 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 13 04:23:22.249242 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 7/13] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:22.312589 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-46681019-2239-49a7-9d6c-050706dd9417 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "name": "ds2G", "os-flavor-access:is_public": true, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:22.331615 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-46681019-2239-49a7-9d6c-050706dd9417 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.074734 Aug 13 04:23:22.333538 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 7/14] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Aug 13 04:23:22 2021] POST /compute/v2.1/flavors => generated 404 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:23:22.344163 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-4c9fbabc-6940-4cba-988e-f8a2b612a503 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:22.370962 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-4c9fbabc-6940-4cba-988e-f8a2b612a503 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030390 Aug 13 04:23:22.371561 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 8/15] 10.222.0.13 () {64 vars in 1336 bytes} [Fri Aug 13 04:23:22 2021] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:23:24.589830 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-46681019-2239-49a7-9d6c-050706dd9417 admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:24.591418 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-46681019-2239-49a7-9d6c-050706dd9417 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002124 Aug 13 04:23:24.593634 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 8/16] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:24 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:24.659901 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-9ce7eb12-cec2-42ae-bbc1-643df2c9a73e admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "ram": 4096, "name": "ds4G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 4, "os-flavor-access:is_public": true, "id": "d4", "disk": 20}} {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:24.682770 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-9ce7eb12-cec2-42ae-bbc1-643df2c9a73e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.083952 Aug 13 04:23:24.685477 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 9/17] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Aug 13 04:23:24 2021] POST /compute/v2.1/flavors => generated 404 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:23:24.696041 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-3ca1f774-aa3b-41f9-8ec6-321cb9729c53 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:24.721085 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-3ca1f774-aa3b-41f9-8ec6-321cb9729c53 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028917 Aug 13 04:23:24.730130 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 9/18] 10.222.0.13 () {64 vars in 1336 bytes} [Fri Aug 13 04:23:24 2021] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:23:26.926787 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-9ce7eb12-cec2-42ae-bbc1-643df2c9a73e admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:26.927801 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-9ce7eb12-cec2-42ae-bbc1-643df2c9a73e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 Aug 13 04:23:26.928211 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 10/19] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:26 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:26.992763 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-98df42eb-3fc2-4c6f-a656-2612bbc4dc1b admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:27.020278 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-98df42eb-3fc2-4c6f-a656-2612bbc4dc1b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.084838 Aug 13 04:23:27.021141 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 10/20] 10.222.0.13 () {60 vars in 1292 bytes} [Fri Aug 13 04:23:26 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:23:29.311019 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-9ce7eb12-cec2-42ae-bbc1-643df2c9a73e admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:29.312035 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-9ce7eb12-cec2-42ae-bbc1-643df2c9a73e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001485 Aug 13 04:23:29.312438 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 11/21] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:29.372368 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-9b1a71ad-fdba-48a3-9b7a-a9c33203c10a admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "name": "m1.tiny", "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "swap": 0, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:29.395231 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-9b1a71ad-fdba-48a3-9b7a-a9c33203c10a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.076089 Aug 13 04:23:29.395791 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 11/22] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Aug 13 04:23:29 2021] POST /compute/v2.1/flavors => generated 402 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:23:29.408854 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-4933a5c5-ee2b-433f-962c-e99ac1530f6b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:29.436656 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-4933a5c5-ee2b-433f-962c-e99ac1530f6b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032003 Aug 13 04:23:29.443840 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 12/23] 10.222.0.13 () {64 vars in 1333 bytes} [Fri Aug 13 04:23:29 2021] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:23:31.663229 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-9b1a71ad-fdba-48a3-9b7a-a9c33203c10a admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:31.664289 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-9b1a71ad-fdba-48a3-9b7a-a9c33203c10a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001540 Aug 13 04:23:31.664712 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 12/24] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:31 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:31.727798 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-ee2ba533-a505-422c-93e5-5fbee2cd2b7b admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "2", "swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "ram": 2048, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.small"}} {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:31.745602 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-ee2ba533-a505-422c-93e5-5fbee2cd2b7b admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.073756 Aug 13 04:23:31.746161 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 13/25] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Aug 13 04:23:31 2021] POST /compute/v2.1/flavors => generated 405 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:23:31.760786 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-a021f66b-3fe6-4c74-b3cb-1afc5dd06e26 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:31.787626 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-a021f66b-3fe6-4c74-b3cb-1afc5dd06e26 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030318 Aug 13 04:23:31.788136 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 13/26] 10.222.0.13 () {64 vars in 1333 bytes} [Fri Aug 13 04:23:31 2021] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:23:33.979259 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-ee2ba533-a505-422c-93e5-5fbee2cd2b7b admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:33.980282 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-ee2ba533-a505-422c-93e5-5fbee2cd2b7b admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Aug 13 04:23:33.980691 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 14/27] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:33 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:34.040854 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-45b55865-c095-4484-9cb2-709cf82dbdb6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "id": "3", "vcpus": 2, "swap": 0, "os-flavor-access:is_public": true, "ram": 4096, "rxtx_factor": 1.0, "disk": 40, "name": "m1.medium"}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:34.059145 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-45b55865-c095-4484-9cb2-709cf82dbdb6 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.071429 Aug 13 04:23:34.059687 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 14/28] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Aug 13 04:23:33 2021] POST /compute/v2.1/flavors => generated 406 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:23:34.072535 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-e3a89996-e765-41b4-ac82-8a28c81ae0bf admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:34.096418 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-e3a89996-e765-41b4-ac82-8a28c81ae0bf admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027485 Aug 13 04:23:34.097133 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 15/29] 10.222.0.13 () {64 vars in 1333 bytes} [Fri Aug 13 04:23:34 2021] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:23:36.307726 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-45b55865-c095-4484-9cb2-709cf82dbdb6 admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:36.309852 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-45b55865-c095-4484-9cb2-709cf82dbdb6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.005216 Aug 13 04:23:36.311850 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 15/30] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:36 2021] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:36.375635 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-80d71134-6bd1-420f-8de1-870850877cfb admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "os-flavor-access:is_public": true, "name": "m1.large", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "ram": 8192, "id": "4", "vcpus": 4, "rxtx_factor": 1.0}} {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:36.394208 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-80d71134-6bd1-420f-8de1-870850877cfb admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.074434 Aug 13 04:23:36.394790 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 16/31] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Aug 13 04:23:36 2021] POST /compute/v2.1/flavors => generated 405 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:23:36.406922 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-c2cd8c63-1301-470a-b7ee-775c73b12fa0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:36.429764 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-c2cd8c63-1301-470a-b7ee-775c73b12fa0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.026345 Aug 13 04:23:36.430336 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 16/32] 10.222.0.13 () {64 vars in 1333 bytes} [Fri Aug 13 04:23:36 2021] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:23:38.631079 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-80d71134-6bd1-420f-8de1-870850877cfb admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:23:38.632693 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-80d71134-6bd1-420f-8de1-870850877cfb admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002113 Aug 13 04:23:38.633172 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 17/33] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:23:38 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:23:38.700573 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-f58e54b8-7c30-46c5-873a-ba0bb5ab820e admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "id": "5", "rxtx_factor": 1.0, "vcpus": 8, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.xlarge"}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:38.722774 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-f58e54b8-7c30-46c5-873a-ba0bb5ab820e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.082801 Aug 13 04:23:38.723426 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 17/34] 10.222.0.13 () {64 vars in 1283 bytes} [Fri Aug 13 04:23:38 2021] POST /compute/v2.1/flavors => generated 408 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:23:38.736451 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-ffefa760-0d4f-4839-934d-1d2bb39c4bf3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:23:38.760928 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-ffefa760-0d4f-4839-934d-1d2bb39c4bf3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028093 Aug 13 04:23:38.761592 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 18/35] 10.222.0.13 () {64 vars in 1333 bytes} [Fri Aug 13 04:23:38 2021] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:24:19.477056 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-f58e54b8-7c30-46c5-873a-ba0bb5ab820e admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:19.478119 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-f58e54b8-7c30-46c5-873a-ba0bb5ab820e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001456 Aug 13 04:24:19.478504 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 18/36] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:24:19 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:24:19.538261 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-69d73f04-6125-4dc7-9eed-55d9fdfef47f admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:19.555448 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-69d73f04-6125-4dc7-9eed-55d9fdfef47f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069450 Aug 13 04:24:19.555979 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 19/37] 10.222.0.13 () {60 vars in 1292 bytes} [Fri Aug 13 04:24:19 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:24:21.011518 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-f58e54b8-7c30-46c5-873a-ba0bb5ab820e admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:21.012519 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-f58e54b8-7c30-46c5-873a-ba0bb5ab820e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Aug 13 04:24:21.012946 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 19/38] 10.222.0.13 () {56 vars in 1075 bytes} [Fri Aug 13 04:24:21 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:24:21.208463 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-c0f18379-7521-4cc7-b247-acbc7c1bc8ef admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:21.214102 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.wsgi [None req-c0f18379-7521-4cc7-b247-acbc7c1bc8ef admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 13 04:24:21.214675 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-c0f18379-7521-4cc7-b247-acbc7c1bc8ef admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:24:21.215485 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-c0f18379-7521-4cc7-b247-acbc7c1bc8ef admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.059619 Aug 13 04:24:21.216016 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 20/39] 10.222.0.13 () {60 vars in 1191 bytes} [Fri Aug 13 04:24:21 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 13 04:24:21.225901 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-619a6ae8-0d16-401c-8975-f0cf7d3fcb80 admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:21.247513 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-619a6ae8-0d16-401c-8975-f0cf7d3fcb80 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.025102 Aug 13 04:24:21.248971 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 20/40] 10.222.0.13 () {60 vars in 1211 bytes} [Fri Aug 13 04:24:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:24:21.259604 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-5e5247e5-6f8d-46a5-a807-bb00cabb2dc6 admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:21.281110 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-5e5247e5-6f8d-46a5-a807-bb00cabb2dc6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.024981 Aug 13 04:24:21.281700 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 21/41] 10.222.0.13 () {60 vars in 1211 bytes} [Fri Aug 13 04:24:21 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:24:21.291816 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-3914beeb-3b6a-4cd6-84cd-c8d0abb78748 admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:21.297842 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.wsgi [None req-3914beeb-3b6a-4cd6-84cd-c8d0abb78748 admin admin] HTTP exception thrown: Flavor 42 could not be found. Aug 13 04:24:21.298419 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-3914beeb-3b6a-4cd6-84cd-c8d0abb78748 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=93199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:24:21.299228 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-3914beeb-3b6a-4cd6-84cd-c8d0abb78748 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.88 time: 0.011054 Aug 13 04:24:21.299751 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 21/42] 10.222.0.13 () {60 vars in 1191 bytes} [Fri Aug 13 04:24:21 2021] GET /compute/v2.1/flavors/42 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 13 04:24:22.650632 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-5e5247e5-6f8d-46a5-a807-bb00cabb2dc6 admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:22.651646 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-5e5247e5-6f8d-46a5-a807-bb00cabb2dc6 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 13 04:24:22.652036 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 22/43] 10.222.0.13 () {56 vars in 1075 bytes} [Fri Aug 13 04:24:22 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:24:22.851109 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-f81e6cbe-3cd2-4fcf-939b-bbd7e7ae9c97 admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:22.856930 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.wsgi [None req-f81e6cbe-3cd2-4fcf-939b-bbd7e7ae9c97 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 13 04:24:22.857576 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-f81e6cbe-3cd2-4fcf-939b-bbd7e7ae9c97 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:24:22.858382 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-f81e6cbe-3cd2-4fcf-939b-bbd7e7ae9c97 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.060962 Aug 13 04:24:22.858899 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 22/44] 10.222.0.13 () {60 vars in 1191 bytes} [Fri Aug 13 04:24:22 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 13 04:24:22.868714 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-2301a854-42c5-447f-8a6a-abf53273256b admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:22.884639 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-2301a854-42c5-447f-8a6a-abf53273256b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.019422 Aug 13 04:24:22.885214 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 23/45] 10.222.0.13 () {60 vars in 1211 bytes} [Fri Aug 13 04:24:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:24:22.896088 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-5b3f6690-fa04-45ce-bbb1-c35abbbd690e admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:22.910393 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-5b3f6690-fa04-45ce-bbb1-c35abbbd690e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017724 Aug 13 04:24:22.910799 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 23/46] 10.222.0.13 () {60 vars in 1211 bytes} [Fri Aug 13 04:24:22 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:24:22.921773 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-13064b27-94f6-4668-a482-54f3b8832199 admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:22.927125 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.wsgi [None req-13064b27-94f6-4668-a482-54f3b8832199 admin admin] HTTP exception thrown: Flavor 84 could not be found. Aug 13 04:24:22.927685 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-13064b27-94f6-4668-a482-54f3b8832199 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=93200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:24:22.928488 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-13064b27-94f6-4668-a482-54f3b8832199 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.88 time: 0.011056 Aug 13 04:24:22.928998 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 24/47] 10.222.0.13 () {60 vars in 1191 bytes} [Fri Aug 13 04:24:22 2021] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 13 04:24:24.295573 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-5b3f6690-fa04-45ce-bbb1-c35abbbd690e admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:24.296575 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-5b3f6690-fa04-45ce-bbb1-c35abbbd690e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Aug 13 04:24:24.296971 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 24/48] 10.222.0.13 () {56 vars in 1075 bytes} [Fri Aug 13 04:24:24 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:24:24.492106 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-13323f3d-c6c7-4746-a800-708c92bbe78a admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:24.498015 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.wsgi [None req-13323f3d-c6c7-4746-a800-708c92bbe78a admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 13 04:24:24.498663 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-13323f3d-c6c7-4746-a800-708c92bbe78a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93200) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:24:24.499544 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-13323f3d-c6c7-4746-a800-708c92bbe78a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.060941 Aug 13 04:24:24.500142 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 25/49] 10.222.0.13 () {60 vars in 1194 bytes} [Fri Aug 13 04:24:24 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Aug 13 04:24:24.510464 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-502257e6-0f50-4cd6-942c-9a34dab66b30 admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:24.526508 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-502257e6-0f50-4cd6-942c-9a34dab66b30 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.019548 Aug 13 04:24:24.527688 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 25/50] 10.222.0.13 () {60 vars in 1211 bytes} [Fri Aug 13 04:24:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:24:24.538639 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:24.552122 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.88 time: 0.017322 Aug 13 04:24:24.553229 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 26/51] 10.222.0.13 () {60 vars in 1211 bytes} [Fri Aug 13 04:24:24 2021] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:24:24.563592 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-61d785d4-23b3-4000-8c8e-9dab453c8fb2 admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:24.568873 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.wsgi [None req-61d785d4-23b3-4000-8c8e-9dab453c8fb2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Aug 13 04:24:24.569444 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-61d785d4-23b3-4000-8c8e-9dab453c8fb2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=93199) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:24:24.570241 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-61d785d4-23b3-4000-8c8e-9dab453c8fb2 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.88 time: 0.010355 Aug 13 04:24:24.570740 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 26/52] 10.222.0.13 () {60 vars in 1194 bytes} [Fri Aug 13 04:24:24 2021] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Aug 13 04:24:25.964852 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:25.966437 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Aug 13 04:24:25.967051 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 27/53] 10.222.0.13 () {56 vars in 1075 bytes} [Fri Aug 13 04:24:25 2021] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:24:26.161670 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-2e19164b-a63b-4192-8951-9a9dc2ba45a0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:24:26.181218 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-2e19164b-a63b-4192-8951-9a9dc2ba45a0 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.88 time: 0.071181 Aug 13 04:24:26.181711 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 27/54] 10.222.0.13 () {64 vars in 1236 bytes} [Fri Aug 13 04:24:26 2021] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:24:27.542615 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:27.543602 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001403 Aug 13 04:24:27.543993 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 28/55] 10.222.0.13 () {56 vars in 1075 bytes} [Fri Aug 13 04:24:27 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:24:27.733848 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-b241aac8-181c-406c-8bce-2c63d49b56c7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:24:27.752238 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-b241aac8-181c-406c-8bce-2c63d49b56c7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.88 time: 0.070545 Aug 13 04:24:27.752734 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 28/56] 10.222.0.13 () {64 vars in 1236 bytes} [Fri Aug 13 04:24:27 2021] POST /compute/v2.1/flavors => generated 405 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:24:29.109661 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:29.110669 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Aug 13 04:24:29.111065 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 29/57] 10.222.0.13 () {56 vars in 1075 bytes} [Fri Aug 13 04:24:29 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:24:29.309351 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-0b8ec0fb-c677-4a4f-bb12-30781043d299 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:24:29.327341 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-0b8ec0fb-c677-4a4f-bb12-30781043d299 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.88 time: 0.071029 Aug 13 04:24:29.327797 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 29/58] 10.222.0.13 () {64 vars in 1236 bytes} [Fri Aug 13 04:24:29 2021] POST /compute/v2.1/flavors => generated 407 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:24:30.679325 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:30.680912 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001958 Aug 13 04:24:30.681369 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 30/59] 10.222.0.13 () {56 vars in 1075 bytes} [Fri Aug 13 04:24:30 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:24:30.877443 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-11dd1202-3feb-46c5-bb32-a0d0daf76c0e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:24:30.896703 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-11dd1202-3feb-46c5-bb32-a0d0daf76c0e admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.88 time: 0.072949 Aug 13 04:24:30.897260 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 30/60] 10.222.0.13 () {64 vars in 1236 bytes} [Fri Aug 13 04:24:30 2021] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:24:32.278813 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:32.279821 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Aug 13 04:24:32.280222 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 31/61] 10.222.0.13 () {56 vars in 1075 bytes} [Fri Aug 13 04:24:32 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:24:32.486146 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-b5a8b592-14ec-425a-baf1-e3a6a5da827a admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:24:32.508021 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-b5a8b592-14ec-425a-baf1-e3a6a5da827a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.88 time: 0.080550 Aug 13 04:24:32.508518 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 31/62] 10.222.0.13 () {60 vars in 1203 bytes} [Fri Aug 13 04:24:32 2021] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:25:18.570208 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:25:18.571218 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-e9ffad0f-607b-4033-8779-563c7b93f84e admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001459 Aug 13 04:25:18.571617 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 32/63] 10.222.0.13 () {54 vars in 931 bytes} [Fri Aug 13 04:25:18 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:25:18.631078 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-099643c5-9c88-4faf-99f3-8c36b10a0d3b admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:25:18.650924 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-099643c5-9c88-4faf-99f3-8c36b10a0d3b admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072695 Aug 13 04:25:18.651464 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 32/64] 10.222.0.13 () {60 vars in 1292 bytes} [Fri Aug 13 04:25:18 2021] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:25:18.673508 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-3807117a-f85b-41f2-8429-8900daa75ad4 admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:25:18.681624 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-3807117a-f85b-41f2-8429-8900daa75ad4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011607 Aug 13 04:25:18.682149 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 33/65] 10.222.0.13 () {60 vars in 1283 bytes} [Fri Aug 13 04:25:18 2021] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:25:18.694308 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-136e388f-f7e3-46c3-b722-b09c884ca0f6 admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:25:18.701924 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-136e388f-f7e3-46c3-b722-b09c884ca0f6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011660 Aug 13 04:25:18.702429 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 33/66] 10.222.0.13 () {60 vars in 1286 bytes} [Fri Aug 13 04:25:18 2021] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:25:18.714476 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-14d954bb-8e9c-48f4-b28a-422716720fa5 admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:25:18.721910 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-14d954bb-8e9c-48f4-b28a-422716720fa5 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010859 Aug 13 04:25:18.722483 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 34/67] 10.222.0.13 () {60 vars in 1286 bytes} [Fri Aug 13 04:25:18 2021] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:25:18.734073 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-3dbf7bc3-b9ff-4554-91e7-4cc267af1f2d admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:25:18.741538 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-3dbf7bc3-b9ff-4554-91e7-4cc267af1f2d admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010832 Aug 13 04:25:18.742047 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 34/68] 10.222.0.13 () {60 vars in 1283 bytes} [Fri Aug 13 04:25:18 2021] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:26:40.037866 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-816fb588-d32c-4fc2-8b39-844e24eaee85 tempest-verify_tempest_config-432127086 tempest-verify_tempest_config-432127086-project] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:26:40.039836 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-816fb588-d32c-4fc2-8b39-844e24eaee85 tempest-verify_tempest_config-432127086 tempest-verify_tempest_config-432127086-project] 10.222.0.13 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.114555 Aug 13 04:26:40.040361 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 35/69] 10.222.0.13 () {58 vars in 1134 bytes} [Fri Aug 13 04:26:39 2021] GET /compute/v2.1/extensions => generated 22700 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:28:09.312666 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-3dbf7bc3-b9ff-4554-91e7-4cc267af1f2d admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:28:09.313705 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-3dbf7bc3-b9ff-4554-91e7-4cc267af1f2d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Aug 13 04:28:09.314125 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 35/70] 10.222.0.13 () {56 vars in 1075 bytes} [Fri Aug 13 04:28:09 2021] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:28:09.566235 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-4bc3549a-9475-456e-8b98-277f3e0100b7 admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:28:09.567381 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:28:09.567381 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: warnings.warn(msg) Aug 13 04:28:09.568896 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-4bc3549a-9475-456e-8b98-277f3e0100b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:28:09.569336 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-4bc3549a-9475-456e-8b98-277f3e0100b7 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:28:09.570144 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-4bc3549a-9475-456e-8b98-277f3e0100b7 admin admin] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:28:09.570569 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-4bc3549a-9475-456e-8b98-277f3e0100b7 admin admin] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:28:09.612674 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-4bc3549a-9475-456e-8b98-277f3e0100b7 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.157326 Aug 13 04:28:09.613235 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 36/71] 10.222.0.13 () {60 vars in 1194 bytes} [Fri Aug 13 04:28:09 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:28:10.980246 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: DEBUG nova.api.openstack.wsgi [None req-3dbf7bc3-b9ff-4554-91e7-4cc267af1f2d admin admin] Calling method '>' {{(pid=93199) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:28:10.981483 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: INFO nova.api.openstack.requestlog [None req-3dbf7bc3-b9ff-4554-91e7-4cc267af1f2d admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002183 Aug 13 04:28:10.981881 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: [pid: 93199|app: 0|req: 36/72] 10.222.0.13 () {56 vars in 1075 bytes} [Fri Aug 13 04:28:10 2021] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:28:11.178380 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG nova.api.openstack.wsgi [None req-37dcbb5a-c0cb-476c-b9d4-e53eabd9ceb1 admin admin] Calling method '>' {{(pid=93200) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:28:11.179559 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-services:list failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:28:11.179559 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: warnings.warn(msg) Aug 13 04:28:11.181576 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-37dcbb5a-c0cb-476c-b9d4-e53eabd9ceb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:28:11.182025 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-37dcbb5a-c0cb-476c-b9d4-e53eabd9ceb1 admin admin] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:28:11.182814 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-37dcbb5a-c0cb-476c-b9d4-e53eabd9ceb1 admin admin] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:28:11.183245 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: DEBUG oslo_concurrency.lockutils [None req-37dcbb5a-c0cb-476c-b9d4-e53eabd9ceb1 admin admin] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=93200) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:28:11.206567 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: INFO nova.api.openstack.requestlog [None req-37dcbb5a-c0cb-476c-b9d4-e53eabd9ceb1 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.88 time: 0.079714 Aug 13 04:28:11.207129 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: [pid: 93200|app: 0|req: 37/73] 10.222.0.13 () {60 vars in 1194 bytes} [Fri Aug 13 04:28:11 2021] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:29:05.834852 dv-cinder-759961-6-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Aug 13 04:29:05.835396 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: Fri Aug 13 04:29:05 2021 - graceful shutdown triggered... Aug 13 04:29:05.835837 dv-cinder-759961-6-iscsi devstack@n-api.service[93199]: Gracefully killing worker 1 (pid: 93199)... Aug 13 04:29:05.836917 dv-cinder-759961-6-iscsi devstack@n-api.service[93200]: Gracefully killing worker 2 (pid: 93200)... Aug 13 04:29:06.836512 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: worker 1 buried after 1 seconds Aug 13 04:29:06.836512 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: worker 2 buried after 1 seconds Aug 13 04:29:06.836512 dv-cinder-759961-6-iscsi devstack@n-api.service[93198]: goodbye to uWSGI. Aug 13 04:29:06.838114 dv-cinder-759961-6-iscsi systemd[1]: devstack@n-api.service: Succeeded. Aug 13 04:29:06.838656 dv-cinder-759961-6-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Aug 13 04:29:06.841816 dv-cinder-759961-6-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Aug 13 04:29:06.851011 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Aug 13 04:29:06.853619 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 13 04:29:06 2021] *** Aug 13 04:29:06.853782 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 13 04:29:06.853918 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 13 04:29:06.854031 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: nodename: dv-cinder-759961-6-iscsi Aug 13 04:29:06.854147 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: machine: x86_64 Aug 13 04:29:06.854259 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: clock source: unix Aug 13 04:29:06.854367 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: pcre jit disabled Aug 13 04:29:06.854475 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: detected number of CPU cores: 4 Aug 13 04:29:06.854590 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: current working directory: / Aug 13 04:29:06.855201 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: detected binary path: /usr/bin/uwsgi-core Aug 13 04:29:06.855318 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: your processes number limit is 47680 Aug 13 04:29:06.855439 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: your memory page size is 4096 bytes Aug 13 04:29:06.855557 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: detected max file descriptor number: 2048 Aug 13 04:29:06.855668 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: lock engine: pthread robust mutexes Aug 13 04:29:06.855948 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: thunder lock: enabled Aug 13 04:29:06.856382 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Aug 13 04:29:06.856382 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: Python version: 3.8.10 (default, Jun 2 2021, 10:49:15) [GCC 9.4.0] Aug 13 04:29:06.902810 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: Python main interpreter initialized at 0x5623e48179c0 Aug 13 04:29:06.902810 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: python threads support enabled Aug 13 04:29:06.902810 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: your server socket listen backlog is limited to 100 connections Aug 13 04:29:06.902810 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: your mercy for graceful operations on workers is 90 seconds Aug 13 04:29:06.903240 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: mapped 403077 bytes (393 KB) for 2 cores Aug 13 04:29:06.903240 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: *** Operational MODE: preforking *** Aug 13 04:29:06.903445 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: *** uWSGI is running in multiple interpreter mode *** Aug 13 04:29:06.903445 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: spawned uWSGI master process (pid: 108266) Aug 13 04:29:06.903649 dv-cinder-759961-6-iscsi systemd[1]: Started Devstack devstack@n-api.service. Aug 13 04:29:06.905474 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: spawned uWSGI worker 1 (pid: 108287, cores: 1) Aug 13 04:29:06.905474 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: spawned uWSGI worker 2 (pid: 108288, cores: 1) Aug 13 04:29:06.905474 dv-cinder-759961-6-iscsi devstack@n-api.service[108266]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 13 04:29:08.738969 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 13 04:29:08.738969 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: from cryptography.utils import int_from_bytes Aug 13 04:29:08.739655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 13 04:29:08.739655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: from cryptography.utils import int_from_bytes Aug 13 04:29:08.739813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 13 04:29:08.739813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: from cryptography.utils import int_from_bytes Aug 13 04:29:08.739813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 13 04:29:08.739813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: from cryptography.utils import int_from_bytes Aug 13 04:29:11.270550 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 13 04:29:11.271204 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 13 04:29:11.271204 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 13 04:29:11.271810 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 13 04:29:11.272086 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 13 04:29:11.272480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.272818 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.273148 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.273583 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.273933 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.274253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.274579 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.274906 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.275258 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.275516 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.275841 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.276174 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759961-6-iscsi {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.276578 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.276891 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.277209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.277601 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.277863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.278198 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.278513 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.279025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.280442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.280442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.280442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.280442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.280783 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.281039 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.281360 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.281705 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.282047 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.282366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.285166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759961-6-iscsi {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.285166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.285166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.285166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.285166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.285166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.285166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.285166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.286032 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.286032 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.286032 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.286429 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.286653 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 13 04:29:11.287410 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.287624 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 13 04:29:11.287846 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.288068 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 13 04:29:11.288281 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.288500 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 13 04:29:11.288733 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.288947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 13 04:29:11.289171 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.289387 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.289616 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.289793 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.290013 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.290161 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.290355 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.290355 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.290675 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.290868 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.291022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.291184 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.291344 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.291520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.291672 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.291814 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.292493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.292663 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.293420 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.293631 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.293779 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.293921 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.294087 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.294347 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.294508 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-759961-6-iscsi {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.294665 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.295673 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.295836 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.295990 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.296148 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.296300 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.296451 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.296603 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.296756 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.296907 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.297068 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.297211 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.297352 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.297530 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.297690 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.297690 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.298058 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.298227 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.298370 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.298511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.298660 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.298830 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.298981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.299130 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.299281 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.299281 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.299570 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.299570 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.299844 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.299994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.300136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.300136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.300412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.300412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.300698 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.300845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.300998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.301140 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.301846 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-759961-6-iscsi {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.302003 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.302155 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.302305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.302456 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.302608 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.302759 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.302901 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.303050 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.303210 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.303363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.303515 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.303668 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.303820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.303820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.304103 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.304334 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.304488 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.304638 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.304780 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.304944 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.305978 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.306144 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.306300 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.306450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.306602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.306751 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.306893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.307048 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.307202 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.307361 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.307510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.308264 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.308574 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.309323 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.309493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.309655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.309810 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.309965 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.310121 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.310446 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.310606 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.310752 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.310902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.311044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.311195 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.311344 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.311499 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.311649 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.311804 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.311962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.312124 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.312124 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.312404 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.312545 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.312697 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.312852 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(tenant)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.313004 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.314500 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.314682 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.320614 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.320820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.320979 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.321130 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.321557 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.321733 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.321896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.322047 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.322197 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.322341 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.324501 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.324703 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.324867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.325020 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.325173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.325324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.325505 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.325663 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.325844 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.326031 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.326210 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.326416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.326579 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.326723 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.326919 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.327067 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.327217 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.327360 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.327517 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.327661 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.327803 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.332849 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.332849 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.333203 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.333374 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.333597 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.333748 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.333910 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.334064 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.334217 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.334366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.334508 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.334658 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.334808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.334960 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.335113 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.335257 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.335399 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.335578 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.335747 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.335897 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.336057 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.336218 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.336361 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.336508 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.336651 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.336808 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.336960 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.337103 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.337253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.337403 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.337584 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.337751 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.337894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.337894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.338237 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.338431 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.338626 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.338807 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.339039 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.339256 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.339940 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.340148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.340310 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.340454 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.340619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.340808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.340963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.341113 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.341273 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.341416 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.341655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.341804 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.341953 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.342105 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.342270 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.342417 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.342582 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.342733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.342875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.343026 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.343169 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.343311 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.343460 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.343602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.343602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.343875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.344017 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.344158 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.344315 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.344475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.344629 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.344772 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.344913 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.345060 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.345301 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.345301 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.345620 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.345773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.345923 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.345923 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.346292 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.346292 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.346766 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.346917 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.347060 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.347217 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.349585 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.349769 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.349920 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.350065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.350208 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.350360 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.350515 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.350667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.350810 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.350972 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.351129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.351272 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.351423 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.351573 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.351726 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.351870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.352032 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.352179 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.352320 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.352471 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.352626 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.352780 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.352923 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.353073 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.353223 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.353365 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.353543 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.353697 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.353849 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.354000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.354155 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.354311 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.357380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.357610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 13 04:29:11.357827 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.358023 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.358206 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.358362 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.358526 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.358678 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.358835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.358989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.359139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.359290 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.359444 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.359587 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.359743 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.359910 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.360053 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.360202 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.360343 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.360492 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.360643 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.360785 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.360933 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.361075 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.361216 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.361356 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.361552 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.361708 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.361850 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.361990 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.362132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.362282 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.362423 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.362571 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.362719 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.362873 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.365440 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.365781 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.365954 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.366180 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.366424 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.366586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.366771 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.366991 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.367143 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.367295 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.367508 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.367744 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.367889 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.368046 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.368190 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.368448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.368682 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.368903 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.369067 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.370867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.371870 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.372056 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.372454 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.372610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.372755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.373013 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.373193 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.374655 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.374873 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.375064 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.375449 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.375685 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.375845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.375990 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.376177 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.376327 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.376653 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.376855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.376999 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.376999 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.377982 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.378136 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.378323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.378490 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.378643 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.378786 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.379335 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.379489 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.379632 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.379785 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.379928 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.380071 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.380234 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.380412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.380573 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.380725 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.380906 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.380906 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.381200 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.381350 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.381544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.381697 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.381839 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.381980 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.382141 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.382372 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.382642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.382798 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.382941 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.383128 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.383424 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.383575 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.383751 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.384026 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.384203 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.385626 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.385834 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.387267 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.387465 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.387656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.387903 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.388059 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.388204 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.388358 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.388503 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.388653 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.388832 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.388980 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.389132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.389289 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.389497 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.389660 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.389835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.389983 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.390125 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.390274 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.390417 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.390560 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.390701 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.390875 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.391019 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.391173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.391380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.391542 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.391685 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.391839 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.391995 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.392143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.392292 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.392448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.392598 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.392747 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.392935 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.393083 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.393236 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.393387 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.393553 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.393696 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.393848 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.394017 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.394273 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.394429 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.394692 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.394867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.395594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.395755 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.395907 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.396049 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.396201 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.396353 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.396496 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.396637 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.396785 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.396971 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.397117 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.397268 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.397410 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.397589 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.397744 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.397896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.398038 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.398203 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.398360 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.398501 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.398649 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.398791 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.398933 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.399087 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.399230 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.399378 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.399520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.399716 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.399876 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.400018 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.400178 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.400329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.400471 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.400620 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.400804 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.400952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.401135 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.401302 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.401488 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.402401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.402573 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.402718 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.402872 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.403022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.403171 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.403348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.403593 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.403773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.403918 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.404067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.404246 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.404418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.404570 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.404740 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.404974 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.405153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.405518 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.405775 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.405932 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.406075 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.406224 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.406379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.406527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.406683 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.406831 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.406985 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] api_database.use_db_reconnect = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.407177 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.407338 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_vgpu_types = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.407539 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.407539 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.407838 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.407993 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.408153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.408350 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.408507 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.408663 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.408663 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.409146 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.409309 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.409490 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.410435 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.410611 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.410761 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.410918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.411076 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.411225 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.411225 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.411519 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.411713 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.411902 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.412058 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.412206 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.412369 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.412537 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.412694 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.412850 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413007 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413175 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413641 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413798 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.413946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.415231 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.415231 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.415886 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.416053 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.416203 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.416359 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.416517 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.416676 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.417662 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.417876 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.417876 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.418743 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.418905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.419064 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.419213 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.419368 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.419524 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.419758 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.419981 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.420135 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.420283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.420438 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.420586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.420586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.420586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.421042 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.421189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.421336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.421543 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.421741 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.421894 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.422050 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.422205 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.422361 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.422518 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.422678 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.422826 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.422981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.423129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.423282 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.423449 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.423607 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.423755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.423755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.423755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.423755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.423755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.424475 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.424632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.424794 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.424951 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.425101 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.425362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.425362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.425801 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.426063 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.426221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.426369 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.426524 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.426679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.426828 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.426994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.427151 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.427307 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.427454 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.427602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.427757 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.427958 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.428113 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.428262 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.428409 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.428566 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.428724 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.428881 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.429040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.429188 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.429188 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.429533 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.429703 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.429852 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.429999 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.430155 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.430312 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.430460 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.430615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.430615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.430904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.431061 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.431216 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.431374 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.431532 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.431689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.431836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.431983 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.432137 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.432294 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.432452 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.432677 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.433958 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.434133 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.434284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.434446 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.434604 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.434760 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.434908 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.435057 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.435212 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.435526 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.435687 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.435860 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.436119 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.436287 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.436448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.436611 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.436768 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.436916 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.437070 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.437226 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.437388 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.437575 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.437726 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.437882 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.438030 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.438185 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.438347 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.438517 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.438674 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.438829 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.438983 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.439139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.439296 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.439444 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.439598 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.439747 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.439892 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.440046 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.440208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.440401 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.440577 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.440727 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.441081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.441250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.441408 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.441408 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.441840 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.441996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.442143 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.442456 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.442456 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.442768 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.442938 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.443096 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.443244 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.443413 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.443566 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.443714 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.443861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.444016 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.444199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.444441 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.444600 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.444757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.444913 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.445077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.445238 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.445394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.445574 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.445734 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.445891 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.446050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.446552 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.446708 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.446855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.447001 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.447163 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.447319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.447487 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.447637 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.447792 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.447949 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.448113 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.448729 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.448908 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.449058 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.449207 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.449489 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.449658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.449814 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.449963 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.450162 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.450326 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.450326 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.450675 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.450861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.451010 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.451227 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.451388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.451550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.451550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.451550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.451969 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.452136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.452136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.452476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.452625 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.452772 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.452919 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.453065 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.453342 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.453522 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.453689 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.453847 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.453997 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.454152 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.454321 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.454515 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.454667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.454822 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.454970 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.455116 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.455272 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.455272 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.455593 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.455746 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.455893 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.456051 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.456213 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.456463 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.456628 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.456628 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.456917 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.456917 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.457219 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.457219 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.457619 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.457774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.457922 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.458085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.458244 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.458442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.458615 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.458615 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.458912 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.459069 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.459217 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.459363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.459510 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.459510 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.459836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.459836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.460132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.460286 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.460450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.460598 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.460754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.460910 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.461066 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.461214 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.461361 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.461532 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.461698 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.461895 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.462055 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.462212 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.462360 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.462529 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.462691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.462848 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.463004 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.463152 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.463305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.463463 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.463621 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.464328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.464572 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.464665 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.464746 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.464851 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.464929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465080 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465169 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465592 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465700 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465798 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465900 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.465999 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466115 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466200 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466282 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466446 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466535 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466617 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466767 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466838 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466920 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.466999 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467077 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467149 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467217 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467286 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467441 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467512 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467581 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467726 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467809 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467888 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.467966 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468043 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468120 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468203 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468303 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468471 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468471 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468645 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468899 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.468969 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469140 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469224 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469367 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469562 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469727 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469799 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.469939 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470008 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470083 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470167 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470239 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470309 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470309 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470520 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470606 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470606 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470732 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.470946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471017 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471094 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471172 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471320 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471397 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471468 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471536 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471612 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471760 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471836 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.471985 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472062 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472140 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472288 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472369 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472453 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472525 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472594 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472663 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472745 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472817 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472885 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.472960 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473037 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473114 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473193 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473362 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473470 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473558 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473629 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.473954 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474038 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474128 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474291 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474389 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474481 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474572 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474899 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.474991 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475075 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475166 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475333 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475415 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475505 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475692 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475777 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475866 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.475962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476046 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476046 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476200 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476200 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476360 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476533 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476622 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476694 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476784 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476874 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.476958 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477052 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477136 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477219 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477301 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477391 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477505 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477599 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477822 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477903 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.477994 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478086 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478335 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478425 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478512 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478584 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478584 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478808 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.478896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.479093 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.479181 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.479281 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.479281 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480119 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480243 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480334 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480432 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480513 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480583 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480668 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480668 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480805 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480883 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.480953 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481108 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481181 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481324 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481603 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481713 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.481968 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482153 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482245 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482402 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482473 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482541 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482698 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482768 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482913 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.482997 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.483121 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.483208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.483299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.483390 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.483475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.483571 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.483656 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.483747 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.483838 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.483921 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484011 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484103 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484187 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484270 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484342 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484487 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484641 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484785 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484862 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.484953 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.485045 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.485137 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.485221 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.485306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.485388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.485573 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.485698 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.485811 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.485929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486126 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486217 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486370 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486370 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486528 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486611 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486705 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486785 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486869 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.486952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487042 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487138 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487235 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487324 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487406 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487570 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487666 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487764 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.487949 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.488034 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.488124 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.488220 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.488353 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.488724 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.488822 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.488915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.488989 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489073 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489241 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489241 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489407 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489519 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489617 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489811 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489897 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.489979 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490062 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490158 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490337 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490423 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490494 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490589 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490673 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490764 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490910 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.490980 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491058 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491128 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491210 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491291 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491373 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491462 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491574 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491654 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491824 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.491916 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492007 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492007 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492331 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492331 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492598 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492688 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492781 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.492955 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493135 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493224 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493309 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493309 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493574 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493749 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493831 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.493922 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494012 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494109 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494195 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494285 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494369 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494543 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494543 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494695 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494777 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.494951 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495047 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495293 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495370 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495454 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495526 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495672 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495672 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495803 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495882 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.495953 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496029 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496098 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496187 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496278 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496366 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496437 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496519 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496601 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496682 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496771 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496856 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.496928 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497017 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497101 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497184 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497275 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497359 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497686 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497788 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497883 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.497974 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.498060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.498142 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.498254 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.498348 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.498487 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.498575 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.498665 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.498757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.498887 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.498989 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499114 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499205 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499294 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499379 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499462 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499644 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499735 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499820 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499908 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.499996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.500088 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.500172 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.500263 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.500355 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.500447 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.500579 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.500579 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.500759 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.500845 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.500967 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.501085 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.501190 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.501277 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.501277 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.501542 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.501644 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.501726 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.501811 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.501897 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.501981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502052 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502215 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502397 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502481 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502655 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502906 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.502997 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503088 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503173 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503256 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503351 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503437 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503603 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503693 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503784 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503877 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.503968 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504059 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504233 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504317 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504413 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504649 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504732 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504826 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.504911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505002 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505086 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505169 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505549 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505647 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505740 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505824 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.505916 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.506058 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.506148 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.506239 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.506331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.506425 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.506549 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.506649 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.506741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.506833 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.506926 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507080 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507174 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507260 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507260 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507410 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507500 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507687 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507772 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.507944 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508035 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508136 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508222 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508312 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508397 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508567 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508652 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508736 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508826 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.508911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.509035 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.509139 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.509270 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.509363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.509512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.509601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.509684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.509785 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.509879 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510012 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510124 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510234 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510332 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510427 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510594 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510817 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510903 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.510976 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511052 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511052 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511186 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511263 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511342 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511421 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511561 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511630 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511697 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511779 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511858 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.511929 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512005 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512144 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512226 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512306 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512377 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_native_luksv1 = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512446 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512522 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512666 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512762 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512854 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.512938 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.513009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.513091 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.513331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.513485 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.513686 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.rbd_volume_local_attach = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.513817 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.514001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.514122 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.514323 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.514450 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.514656 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.514777 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.514985 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.515103 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.515304 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.515432 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.515620 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.515739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.515933 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.516064 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.516245 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.516366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.516628 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.516757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.516875 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.516995 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.517173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.517294 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.517517 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.517641 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.517834 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.517963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.518143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.518270 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.518492 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.518617 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.518810 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.518939 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.519147 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.519274 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.519476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.519596 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.519783 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.519903 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.520112 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.520256 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.520430 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.520615 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.520764 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.520910 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.521077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.521218 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.521382 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.521545 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.521710 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.521845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.522018 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.522161 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.522328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.522474 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.522669 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.522809 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.523007 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.523147 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.523324 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.523465 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.523649 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.523782 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.523961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.524095 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.524277 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.524419 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.524589 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.524723 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.524901 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.525035 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.525215 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.525349 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.525550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.525682 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108287) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 13 04:29:11.525861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.526173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.527016 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.527328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.527654 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.527966 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.528287 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.528592 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.528911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.529223 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] database.use_db_reconnect = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.529602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.529895 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.530220 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.530534 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.530856 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.531173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.531498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.531820 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.532138 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.532448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.532809 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.533088 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.533406 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.533804 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.534097 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.534422 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.535032 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.535493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.536010 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.536348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.536641 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.537035 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.537391 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.537682 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.538000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.538338 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.538655 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.538975 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.539290 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.539605 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.539925 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.540244 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.540575 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.540904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.541259 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.541596 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.542545 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.542989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.543259 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.543618 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 13 04:29:11.543866 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=108288) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 13 04:29:11.550885 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:29:11.568014 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_db.sqlalchemy.engines [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:29:11.721409 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.context [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ad7862d-4e34-4150-8fb8-d2ca44be5989(cell1) {{(pid=108287) load_cells /opt/stack/nova/nova/context.py:464}} Aug 13 04:29:11.725723 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:11.727324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:11.728128 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:11.731228 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:11.738021 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.context [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),9ad7862d-4e34-4150-8fb8-d2ca44be5989(cell1) {{(pid=108288) load_cells /opt/stack/nova/nova/context.py:464}} Aug 13 04:29:11.743150 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:29:11.743281 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:11.743389 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:29:11.743981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:11.744816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:11.747201 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:11.758145 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_db.sqlalchemy.engines [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:29:11.759077 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_db.sqlalchemy.engines [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:29:12.019794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_db.sqlalchemy.engines [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108287) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:29:12.029009 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_db.sqlalchemy.engines [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=108288) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 13 04:29:12.352608 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: WARNING keystonemiddleware.auth_token [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 13 04:29:12.354500 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: WARNING keystonemiddleware.auth_token [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 13 04:29:12.359556 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: WARNING keystonemiddleware.auth_token [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 13 04:29:12.361266 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: WARNING keystonemiddleware.auth_token [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 13 04:29:12.714360 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: WARNING keystonemiddleware.auth_token [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 13 04:29:12.719688 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: WARNING keystonemiddleware.auth_token [None req-4fb0224e-0471-4bef-9646-acd076dc9ff4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 13 04:29:12.720667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: WARNING keystonemiddleware.auth_token [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Aug 13 04:29:12.725077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623e48179c0 pid: 108287 (default app) Aug 13 04:29:12.725842 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: WARNING keystonemiddleware.auth_token [None req-c7fbc055-0dd8-402c-90fe-ce265153b635 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Aug 13 04:29:12.731658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5623e48179c0 pid: 108288 (default app) Aug 13 04:29:46.562174 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6df1c0d0-b284-4dcc-8808-abe270f688ca tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Action: 'create', calling method: .version_select at 0x7fc46dd884c0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-162093946", "metadata": {"Type": "work"}}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:46.563869 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6df1c0d0-b284-4dcc-8808-abe270f688ca tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:29:46.564808 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6df1c0d0-b284-4dcc-8808-abe270f688ca tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.451985 Aug 13 04:29:46.565446 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 1/1] 10.222.0.13 () {60 vars in 1156 bytes} [Fri Aug 13 04:29:45 2021] POST /compute/v2.1/os-volumes => generated 127 bytes in 1455 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 13 04:29:46.780059 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f1eef8d2-6607-46b4-a52c-e5329077ddd0 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Action: 'create', calling method: .version_select at 0x7fc46dd8b4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1997865887"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:46.896758 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-13d079f2-3542-458a-9fd2-d63a88ddfcf9 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Action: 'create', calling method: .version_select at 0x7fc46dcfe0d0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1736624588", "metadata": {"Type": "work"}}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:48.409017 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f1eef8d2-6607-46b4-a52c-e5329077ddd0 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 2.849025 Aug 13 04:29:48.410249 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 1/2] 10.222.0.13 () {60 vars in 1155 bytes} [Fri Aug 13 04:29:45 2021] POST /compute/v2.1/os-volumes => generated 345 bytes in 2852 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Aug 13 04:29:48.415690 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-49d6a374-0cee-4fbd-a361-7cb861b40d67 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Action: 'create', calling method: .version_select at 0x7fc46dccd0d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-146925152", "metadata": {"Type": "work"}}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:48.418498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-49d6a374-0cee-4fbd-a361-7cb861b40d67 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:29:48.425663 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-49d6a374-0cee-4fbd-a361-7cb861b40d67 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.014047 Aug 13 04:29:48.427135 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 2/3] 10.222.0.13 () {60 vars in 1156 bytes} [Fri Aug 13 04:29:48 2021] POST /compute/v2.1/os-volumes => generated 125 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 13 04:29:48.503647 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-13d079f2-3542-458a-9fd2-d63a88ddfcf9 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 1.936834 Aug 13 04:29:48.504254 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 2/4] 10.222.0.13 () {60 vars in 1156 bytes} [Fri Aug 13 04:29:46 2021] POST /compute/v2.1/os-volumes => generated 353 bytes in 1938 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Aug 13 04:29:48.593402 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-870184612", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "networks": [{"uuid": "361ae543-e60e-4018-8f94-c3d879df0f85"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:48.661377 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1506596577", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "networks": [{"uuid": "e5a4407b-136d-4505-b628-117c1b1fc3a4"}]}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:48.854142 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] validate_networks() for [('361ae543-e60e-4018-8f94-c3d879df0f85', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:29:48.879721 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.network.neutron [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] validate_networks() for [('e5a4407b-136d-4505-b628-117c1b1fc3a4', None, None, None)] {{(pid=108287) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:29:50.529027 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Flavor limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:29:50.529681 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Image limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:29:50.529942 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Flavor pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:29:50.530586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Image pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:29:50.531203 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:29:50.561548 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:50.567951 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:50.569154 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:50.569800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:50.671137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Getting quotas for project 44afcd45727640ec80dc17fe4fcf67fb. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:29:50.683148 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Getting quotas for user 1c6fcd7ffd124e7aa7ace34bed7f7423 and project 44afcd45727640ec80dc17fe4fcf67fb. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:29:50.709050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Going to run 1 instances... {{(pid=108287) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:29:50.716370 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:29:50.826301 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:29:50.826867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:29:50.827332 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:29:50.827773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:29:50.828330 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:29:50.855763 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:50.856215 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:50.857019 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:50.857589 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:50.899205 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d9ef0121-6086-4111-815c-2fa4621d0e76 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.385043 Aug 13 04:29:50.904121 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 3/5] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:29:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 2393 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:29:50.918695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-037a660b-62e7-445b-b4f7-7f7ea7a5a7ac tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46db61ca0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:50.938819 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Getting quotas for project 41073eeaf0b24fdda847a5a1ee0954c6. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:29:50.956489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Getting quotas for user a59eead9e8f141bf8a62ad838823e0a7 and project 41073eeaf0b24fdda847a5a1ee0954c6. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:29:50.989607 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:29:50.999808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:29:51.055774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-037a660b-62e7-445b-b4f7-7f7ea7a5a7ac tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e" status: 200 len: 346 microversion: 2.1 time: 0.149368 Aug 13 04:29:51.065056 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 4/6] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:50 2021] GET /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e => generated 346 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:51.081345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-bdd33ece-7d63-4d9d-a138-4816723155f8 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Action: 'create', calling method: .version_select at 0x7fc46db6c9d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1672034634", "metadata": {"Type": "work"}}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:51.102413 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-bdd33ece-7d63-4d9d-a138-4816723155f8 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:29:51.110299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-bdd33ece-7d63-4d9d-a138-4816723155f8 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.041327 Aug 13 04:29:51.110905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 5/7] 10.222.0.13 () {60 vars in 1156 bytes} [Fri Aug 13 04:29:51 2021] POST /compute/v2.1/os-volumes => generated 121 bytes in 45 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 13 04:29:51.127873 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-17b0c23c-5786-44aa-93fc-78bcb44fc467 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46db6c550>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:51.170910 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fec503fa-dc76-48a6-ae55-e0964ebd7ef5 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.736129 Aug 13 04:29:51.172208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 3/8] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:29:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 2741 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:29:51.188443 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1fc3a863-fca8-43e9-8e1d-37354b2aee85 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:51.191577 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1fc3a863-fca8-43e9-8e1d-37354b2aee85 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:51.248397 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-17b0c23c-5786-44aa-93fc-78bcb44fc467 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 200 len: 354 microversion: 2.1 time: 0.133749 Aug 13 04:29:51.248968 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 6/9] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:51 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 354 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:51.255486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-22afb9b8-ade1-4679-9283-3d8bf19d8b8e tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Action: 'create', calling method: .version_select at 0x7fc46d300160>, body: {"snapshot": {"volume_id": "d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-122841110"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:51.424858 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1fc3a863-fca8-43e9-8e1d-37354b2aee85 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:51.461022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1fc3a863-fca8-43e9-8e1d-37354b2aee85 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1218 microversion: 2.1 time: 0.278891 Aug 13 04:29:51.463378 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 4/10] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:51 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1218 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:51.470533 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c05e848c-7091-4509-a946-37142da2ef76 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Calling method '.version_select at 0x7fc46db76c10>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:51.527783 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-c05e848c-7091-4509-a946-37142da2ef76 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] HTTP exception thrown: Volume tempest-invalid-510483040 could not be found. Aug 13 04:29:51.528691 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c05e848c-7091-4509-a946-37142da2ef76 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Returning 404 to user: Volume tempest-invalid-510483040 could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:29:51.530322 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c05e848c-7091-4509-a946-37142da2ef76 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-510483040" status: 404 len: 98 microversion: 2.1 time: 0.065596 Aug 13 04:29:51.531082 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 5/11] 10.222.0.13 () {58 vars in 1215 bytes} [Fri Aug 13 04:29:51 2021] DELETE /compute/v2.1/os-volumes/tempest-invalid-510483040 => generated 98 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Aug 13 04:29:51.539602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fe7a6c3e-60f1-4e91-8ac7-aa3aeb17fcaa tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:51.540861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fe7a6c3e-60f1-4e91-8ac7-aa3aeb17fcaa tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:51.577736 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-22afb9b8-ade1-4679-9283-3d8bf19d8b8e tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.327646 Aug 13 04:29:51.578658 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 7/12] 10.222.0.13 () {60 vars in 1162 bytes} [Fri Aug 13 04:29:51 2021] POST /compute/v2.1/os-snapshots => generated 286 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:51.583785 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e4ca8e80-1ddf-4dad-a0f7-9ea220dcb403 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46db6c040>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:51.668545 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e4ca8e80-1ddf-4dad-a0f7-9ea220dcb403 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 200 len: 354 microversion: 2.1 time: 0.088645 Aug 13 04:29:51.669124 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 8/13] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:51 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:51.674969 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5e501db9-6d40-4298-8cff-68f3685ac3e7 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004548 Aug 13 04:29:51.675740 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 9/14] 10.222.0.13 () {58 vars in 1140 bytes} [Fri Aug 13 04:29:51 2021] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 13 04:29:51.682639 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-992a1219-79f9-4416-bddb-e40400755b1b tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46dd88e50>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:51.719133 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-992a1219-79f9-4416-bddb-e40400755b1b tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 200 len: 286 microversion: 2.1 time: 0.041523 Aug 13 04:29:51.720331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 10/15] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Aug 13 04:29:51 2021] GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 286 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:51.729679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2f3fedc1-c026-4854-9bdb-3eabcec25159 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46d300040>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:51.833888 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2f3fedc1-c026-4854-9bdb-3eabcec25159 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 202 len: 0 microversion: 2.1 time: 0.111959 Aug 13 04:29:51.834862 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 11/16] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Aug 13 04:29:51 2021] DELETE /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:29:51.840675 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dbc8c0dd-36be-46d7-829b-01c0dd684ef9 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004683 Aug 13 04:29:51.841531 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 12/17] 10.222.0.13 () {58 vars in 1137 bytes} [Fri Aug 13 04:29:51 2021] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Aug 13 04:29:51.857698 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e3436bc9-326c-495f-9f81-2adfbff1c481 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46dd88c10>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:51.937271 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e3436bc9-326c-495f-9f81-2adfbff1c481 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.094706 Aug 13 04:29:51.938206 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 13/18] 10.222.0.13 () {58 vars in 1140 bytes} [Fri Aug 13 04:29:51 2021] GET /compute/v2.1/os-snapshots => generated 289 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:51.943045 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e97fb8d7-9f1d-45d7-8425-cd64149c6dac tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46d3003a0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:52.051246 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e97fb8d7-9f1d-45d7-8425-cd64149c6dac tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 200 len: 353 microversion: 2.1 time: 0.111789 Aug 13 04:29:52.052308 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 14/19] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:51 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 353 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:52.058296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-32852ef8-9eff-4c37-b80b-2cf78ec56bea tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Calling method '.version_select at 0x7fc46d3009d0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:52.124060 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-32852ef8-9eff-4c37-b80b-2cf78ec56bea tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] HTTP exception thrown: Volume 5198f480-3a19-4bdd-9a15-932d70b81e0a could not be found. Aug 13 04:29:52.124847 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-32852ef8-9eff-4c37-b80b-2cf78ec56bea tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Returning 404 to user: Volume 5198f480-3a19-4bdd-9a15-932d70b81e0a could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:29:52.125926 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-32852ef8-9eff-4c37-b80b-2cf78ec56bea tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/5198f480-3a19-4bdd-9a15-932d70b81e0a" status: 404 len: 109 microversion: 2.1 time: 0.072456 Aug 13 04:29:52.126937 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 15/20] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Aug 13 04:29:52 2021] DELETE /compute/v2.1/os-volumes/5198f480-3a19-4bdd-9a15-932d70b81e0a => generated 109 bytes in 74 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:29:52.132565 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-cbba3fec-4883-45bb-b5db-033ac4552578 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46d300670>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:52.163701 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-fe7a6c3e-60f1-4e91-8ac7-aa3aeb17fcaa tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:52.171034 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-cbba3fec-4883-45bb-b5db-033ac4552578 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 200 len: 286 microversion: 2.1 time: 0.042533 Aug 13 04:29:52.171616 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fe7a6c3e-60f1-4e91-8ac7-aa3aeb17fcaa tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1214 microversion: 2.1 time: 0.639112 Aug 13 04:29:52.172180 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 6/21] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:51 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1214 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:52.172499 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 16/22] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Aug 13 04:29:52 2021] GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:52.177333 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f38f0c2f-7b92-48cb-aec8-7c8c1152dd18 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Calling method '.version_select at 0x7fc46db6c4c0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:52.238168 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-f38f0c2f-7b92-48cb-aec8-7c8c1152dd18 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] HTTP exception thrown: Volume c0feaf04-0788-41d4-bb32-05e7746ec1ff could not be found. Aug 13 04:29:52.238784 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f38f0c2f-7b92-48cb-aec8-7c8c1152dd18 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] Returning 404 to user: Volume c0feaf04-0788-41d4-bb32-05e7746ec1ff could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:29:52.239716 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f38f0c2f-7b92-48cb-aec8-7c8c1152dd18 tempest-VolumesNegativeTest-1048976163 tempest-VolumesNegativeTest-1048976163-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c0feaf04-0788-41d4-bb32-05e7746ec1ff" status: 404 len: 109 microversion: 2.1 time: 0.066042 Aug 13 04:29:52.240332 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 17/23] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:52 2021] GET /compute/v2.1/os-volumes/c0feaf04-0788-41d4-bb32-05e7746ec1ff => generated 109 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:29:52.480975 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-50faf826-b102-4e98-9d0f-005def194fce tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:52.481961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-50faf826-b102-4e98-9d0f-005def194fce tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:52.632115 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-50faf826-b102-4e98-9d0f-005def194fce tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:52.650448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-50faf826-b102-4e98-9d0f-005def194fce tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1218 microversion: 2.1 time: 0.173312 Aug 13 04:29:52.662373 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 7/24] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:52 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1218 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:53.063820 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ac10faa8-9306-4b31-819b-ba9a8391330a tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46d3285e0>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:53.150119 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ac10faa8-9306-4b31-819b-ba9a8391330a tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 200 len: 353 microversion: 2.1 time: 0.089691 Aug 13 04:29:53.150974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 8/25] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:53 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 353 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:53.196116 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-734f58a1-5001-4981-9207-e7fd0412c6b1 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46d328700>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:53.209840 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-cdc2e347-2bda-47a2-947a-5b25731b1b16 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'create', calling method: .version_select at 0x7fc46db6c700>, body: {"keypair": {"name": "tempest-keypair-187959874"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:53.236974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-734f58a1-5001-4981-9207-e7fd0412c6b1 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 200 len: 286 microversion: 2.1 time: 0.044651 Aug 13 04:29:53.237568 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 9/26] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Aug 13 04:29:53 2021] GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 286 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:53.243113 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0f7fca46-33cf-4e43-8d33-eb763030e912 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:53.244896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0f7fca46-33cf-4e43-8d33-eb763030e912 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:53.262998 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-cdc2e347-2bda-47a2-947a-5b25731b1b16 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for project 14887014218041cc86fddfa8a151dcd6. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:29:53.268396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-cdc2e347-2bda-47a2-947a-5b25731b1b16 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for user 45e5e56984454deb8f490bbf5a0f1435 and project 14887014218041cc86fddfa8a151dcd6. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:29:53.364208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-0f7fca46-33cf-4e43-8d33-eb763030e912 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:53.385453 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0f7fca46-33cf-4e43-8d33-eb763030e912 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1214 microversion: 2.1 time: 0.146515 Aug 13 04:29:53.386034 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 10/27] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:53 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1214 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:53.679418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-6c922060-dd6b-4f26-9287-de20461c0f0e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:53.680264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6c922060-dd6b-4f26-9287-de20461c0f0e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:53.693672 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6c922060-dd6b-4f26-9287-de20461c0f0e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:53.694122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6c922060-dd6b-4f26-9287-de20461c0f0e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:53.713857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6c922060-dd6b-4f26-9287-de20461c0f0e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:53.714618 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6c922060-dd6b-4f26-9287-de20461c0f0e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:53.773446 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-cdc2e347-2bda-47a2-947a-5b25731b1b16 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for project 14887014218041cc86fddfa8a151dcd6. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:29:53.785252 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-cdc2e347-2bda-47a2-947a-5b25731b1b16 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for user 45e5e56984454deb8f490bbf5a0f1435 and project 14887014218041cc86fddfa8a151dcd6. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:29:53.833745 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-cdc2e347-2bda-47a2-947a-5b25731b1b16 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.809244 Aug 13 04:29:53.840101 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 18/28] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Aug 13 04:29:53 2021] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:54.139541 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-6c922060-dd6b-4f26-9287-de20461c0f0e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:54.163458 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-dae88778-ffaa-4792-a0f3-18f7812c9c5a tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46d32c700>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:54.165074 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-6c922060-dd6b-4f26-9287-de20461c0f0e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1222 microversion: 2.1 time: 0.488210 Aug 13 04:29:54.166789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 11/29] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:53 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1222 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:29:54.248662 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d7ab841a-4d07-48fa-af62-51fe1feaf96b tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46d2a53a0>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:54.291920 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dae88778-ffaa-4792-a0f3-18f7812c9c5a tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 200 len: 353 microversion: 2.1 time: 0.133056 Aug 13 04:29:54.292504 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 19/30] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:54 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:29:54.304102 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d7ab841a-4d07-48fa-af62-51fe1feaf96b tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 200 len: 286 microversion: 2.1 time: 0.059007 Aug 13 04:29:54.304934 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 12/31] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Aug 13 04:29:54 2021] GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:29:54.403112 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b107443b-96ea-43a7-b9bf-1e571cf9a332 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:54.403788 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b107443b-96ea-43a7-b9bf-1e571cf9a332 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:54.438558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b107443b-96ea-43a7-b9bf-1e571cf9a332 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:54.439018 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b107443b-96ea-43a7-b9bf-1e571cf9a332 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:54.439812 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b107443b-96ea-43a7-b9bf-1e571cf9a332 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:54.442149 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b107443b-96ea-43a7-b9bf-1e571cf9a332 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:55.184540 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9af4682a-4ac4-4c1c-9e3a-c297b924dc9f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:55.185564 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9af4682a-4ac4-4c1c-9e3a-c297b924dc9f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:55.192362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b107443b-96ea-43a7-b9bf-1e571cf9a332 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:55.217849 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9af4682a-4ac4-4c1c-9e3a-c297b924dc9f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:55.220632 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9af4682a-4ac4-4c1c-9e3a-c297b924dc9f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:55.224522 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9af4682a-4ac4-4c1c-9e3a-c297b924dc9f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:55.226604 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9af4682a-4ac4-4c1c-9e3a-c297b924dc9f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:55.239196 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b107443b-96ea-43a7-b9bf-1e571cf9a332 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1218 microversion: 2.1 time: 0.840532 Aug 13 04:29:55.247845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 20/32] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:54 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1218 bytes in 850 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:55.304287 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-70269c8e-2c97-41cc-8980-3fdf8210ebde tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46ca3c9d0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:55.419535 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9af4682a-4ac4-4c1c-9e3a-c297b924dc9f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:55.428329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9af4682a-4ac4-4c1c-9e3a-c297b924dc9f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1214 microversion: 2.1 time: 0.248875 Aug 13 04:29:55.433563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 13/33] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:55 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1214 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:55.440927 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-70269c8e-2c97-41cc-8980-3fdf8210ebde tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 200 len: 353 microversion: 2.1 time: 0.140416 Aug 13 04:29:55.441640 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 21/34] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:55 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 353 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:55.443988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e1b230e8-8b9c-42c1-a5d4-c5bdf4cdfe77 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46d2b7820>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:55.504244 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e1b230e8-8b9c-42c1-a5d4-c5bdf4cdfe77 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 200 len: 286 microversion: 2.1 time: 0.069164 Aug 13 04:29:55.505537 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 14/35] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Aug 13 04:29:55 2021] GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 286 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:56.262366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-87adcfb3-eeb5-4a3e-b318-bd1da8d2d94e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:56.262994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-87adcfb3-eeb5-4a3e-b318-bd1da8d2d94e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:56.273256 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87adcfb3-eeb5-4a3e-b318-bd1da8d2d94e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:56.273741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87adcfb3-eeb5-4a3e-b318-bd1da8d2d94e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:56.275158 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87adcfb3-eeb5-4a3e-b318-bd1da8d2d94e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:56.276300 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87adcfb3-eeb5-4a3e-b318-bd1da8d2d94e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:56.446676 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d7f5bee1-91ea-4ff8-bc27-b2fa3e2bfb13 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:56.447988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d7f5bee1-91ea-4ff8-bc27-b2fa3e2bfb13 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:56.468518 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d7f5bee1-91ea-4ff8-bc27-b2fa3e2bfb13 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:56.470035 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d7f5bee1-91ea-4ff8-bc27-b2fa3e2bfb13 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:56.471822 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d7f5bee1-91ea-4ff8-bc27-b2fa3e2bfb13 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:56.472702 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d7f5bee1-91ea-4ff8-bc27-b2fa3e2bfb13 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:56.603927 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-87adcfb3-eeb5-4a3e-b318-bd1da8d2d94e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:56.622363 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-87adcfb3-eeb5-4a3e-b318-bd1da8d2d94e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1218 microversion: 2.1 time: 0.365607 Aug 13 04:29:56.623748 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 22/36] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:56 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1218 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:56.638983 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b1f8bb8e-6e94-4ae0-8761-ef62936c0650 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46ca53670>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:56.708192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b1f8bb8e-6e94-4ae0-8761-ef62936c0650 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 200 len: 353 microversion: 2.1 time: 0.083100 Aug 13 04:29:56.708970 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 23/37] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:56 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:56.715695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5fa52ac7-93e1-4cd3-897f-5c899e8bd388 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46ca77a60>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:56.717276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d7f5bee1-91ea-4ff8-bc27-b2fa3e2bfb13 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:56.725941 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d7f5bee1-91ea-4ff8-bc27-b2fa3e2bfb13 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1214 microversion: 2.1 time: 0.283750 Aug 13 04:29:56.729355 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 15/38] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:56 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1214 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:56.737806 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-623803447", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c9aa154-2553-4e43-a430-2b11cf059f5c"}], "security_groups": [{"name": "tempest-securitygroup--1856589443"}], "key_name": "tempest-keypair-187959874", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:56.761709 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5fa52ac7-93e1-4cd3-897f-5c899e8bd388 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 200 len: 286 microversion: 2.1 time: 0.051104 Aug 13 04:29:56.762792 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 24/39] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Aug 13 04:29:56 2021] GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 286 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:56.938725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] validate_networks() for [('9c9aa154-2553-4e43-a430-2b11cf059f5c', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:29:57.182943 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-99a954fe-33de-40d2-9f77-6bb1a0e1ef5e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'create', calling method: .version_select at 0x7fc46ca3cca0>, body: {"keypair": {"name": "tempest-keypair-1951400845"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:29:57.258681 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-99a954fe-33de-40d2-9f77-6bb1a0e1ef5e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for project 97bcef962215442fa34d9ef949492fc4. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:29:57.272186 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-99a954fe-33de-40d2-9f77-6bb1a0e1ef5e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for user 79f213e02f8d44e789aae985fa15d58f and project 97bcef962215442fa34d9ef949492fc4. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:29:57.716320 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:29:57.716846 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:29:57.717270 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:29:57.717704 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:29:57.718119 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:29:57.730540 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:57.730982 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:57.731777 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:57.732199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:57.758446 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for project 14887014218041cc86fddfa8a151dcd6. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:29:57.766261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for user 45e5e56984454deb8f490bbf5a0f1435 and project 14887014218041cc86fddfa8a151dcd6. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:29:57.803968 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:29:57.806832 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:29:57.884992 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-99a954fe-33de-40d2-9f77-6bb1a0e1ef5e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for project 97bcef962215442fa34d9ef949492fc4. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:29:57.893388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-99a954fe-33de-40d2-9f77-6bb1a0e1ef5e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for user 79f213e02f8d44e789aae985fa15d58f and project 97bcef962215442fa34d9ef949492fc4. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:29:57.916887 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-99a954fe-33de-40d2-9f77-6bb1a0e1ef5e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.888690 Aug 13 04:29:57.917668 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 25/40] 10.222.0.13 () {62 vars in 1199 bytes} [Fri Aug 13 04:29:57 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 890 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 13 04:29:57.920522 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-db25c2c4-5276-448c-a59a-ef71663a1d35 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.189702 Aug 13 04:29:57.925730 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 16/41] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:29:56 2021] POST /compute/v2.1/servers => generated 402 bytes in 1195 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:29:57.929352 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b4f68e42-3d5e-4a48-be4c-7f12f22256b9 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:57.960945 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b4f68e42-3d5e-4a48-be4c-7f12f22256b9 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:57.974558 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a62f9890-db93-4a03-a2dd-7ce79c367b00 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46d2b7430>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:57.997036 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b4f68e42-3d5e-4a48-be4c-7f12f22256b9 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:57.999345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b4f68e42-3d5e-4a48-be4c-7f12f22256b9 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:58.000488 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b4f68e42-3d5e-4a48-be4c-7f12f22256b9 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:58.005027 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b4f68e42-3d5e-4a48-be4c-7f12f22256b9 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:58.125469 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a62f9890-db93-4a03-a2dd-7ce79c367b00 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 200 len: 353 microversion: 2.1 time: 0.198262 Aug 13 04:29:58.126349 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 17/42] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:57 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 353 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:58.132896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-6146dca5-f584-4890-813a-377f097bb412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:58.136147 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6146dca5-f584-4890-813a-377f097bb412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:58.156440 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6146dca5-f584-4890-813a-377f097bb412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:58.158072 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6146dca5-f584-4890-813a-377f097bb412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:58.159202 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6146dca5-f584-4890-813a-377f097bb412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:58.161274 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6146dca5-f584-4890-813a-377f097bb412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:58.182211 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b4f68e42-3d5e-4a48-be4c-7f12f22256b9 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:58.202584 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b4f68e42-3d5e-4a48-be4c-7f12f22256b9 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1210 microversion: 2.1 time: 0.283627 Aug 13 04:29:58.203185 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 26/43] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:57 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1210 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:58.222352 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-54a349c8-a9d7-4aa5-96be-d73642feb842 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46db6c550>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:58.272257 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-54a349c8-a9d7-4aa5-96be-d73642feb842 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 200 len: 287 microversion: 2.1 time: 0.058564 Aug 13 04:29:58.273497 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 27/44] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Aug 13 04:29:58 2021] GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 287 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:58.284323 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c5836f86-fd23-4a52-83c9-ed737325425a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:58.284955 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c5836f86-fd23-4a52-83c9-ed737325425a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:58.321904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-6146dca5-f584-4890-813a-377f097bb412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:58.340787 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-6146dca5-f584-4890-813a-377f097bb412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1270 microversion: 2.1 time: 0.212914 Aug 13 04:29:58.343429 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 18/45] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:58 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1270 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:58.356376 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ea6d90b4-070d-40ad-a7a9-ea30089cc433 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46d242160>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:58.404355 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c5836f86-fd23-4a52-83c9-ed737325425a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:58.418082 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c5836f86-fd23-4a52-83c9-ed737325425a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1236 microversion: 2.1 time: 0.143218 Aug 13 04:29:58.419862 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 28/46] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:58 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1236 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:58.512424 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ea6d90b4-070d-40ad-a7a9-ea30089cc433 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 202 len: 0 microversion: 2.1 time: 0.165876 Aug 13 04:29:58.513006 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 19/47] 10.222.0.13 () {58 vars in 1254 bytes} [Fri Aug 13 04:29:58 2021] DELETE /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:29:58.521702 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1ed6c352-e154-4534-8233-a0e4c53e3f2e tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46db6c820>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:58.563666 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1ed6c352-e154-4534-8233-a0e4c53e3f2e tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 200 len: 286 microversion: 2.1 time: 0.045958 Aug 13 04:29:58.564242 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 29/48] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Aug 13 04:29:58 2021] GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 286 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:59.138583 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7543eca4-ce04-4e91-aef0-959b8389a205 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46d1fe1f0>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:59.200838 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7543eca4-ce04-4e91-aef0-959b8389a205 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 200 len: 353 microversion: 2.1 time: 0.065760 Aug 13 04:29:59.201631 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 20/49] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:29:59 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 353 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:29:59.220354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d79b7ccd-9475-4e2a-be59-67914fe66296 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:59.221102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d79b7ccd-9475-4e2a-be59-67914fe66296 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:59.227837 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d79b7ccd-9475-4e2a-be59-67914fe66296 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:59.228375 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d79b7ccd-9475-4e2a-be59-67914fe66296 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:59.229227 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d79b7ccd-9475-4e2a-be59-67914fe66296 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:59.229761 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d79b7ccd-9475-4e2a-be59-67914fe66296 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:59.294739 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d79b7ccd-9475-4e2a-be59-67914fe66296 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:59.302488 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d79b7ccd-9475-4e2a-be59-67914fe66296 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1210 microversion: 2.1 time: 0.085739 Aug 13 04:29:59.303153 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 30/50] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:59 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:59.362088 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-214ce627-c9d1-443b-9c03-51f0fd704b9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:59.362712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-214ce627-c9d1-443b-9c03-51f0fd704b9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:59.369570 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-214ce627-c9d1-443b-9c03-51f0fd704b9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:59.370032 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-214ce627-c9d1-443b-9c03-51f0fd704b9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:59.370902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-214ce627-c9d1-443b-9c03-51f0fd704b9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:59.371336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-214ce627-c9d1-443b-9c03-51f0fd704b9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:59.433497 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-214ce627-c9d1-443b-9c03-51f0fd704b9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:59.442130 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-53d116c4-cdaf-4d37-a4f0-db998fd09ec4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:59.443491 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-214ce627-c9d1-443b-9c03-51f0fd704b9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1270 microversion: 2.1 time: 0.086704 Aug 13 04:29:59.444056 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-53d116c4-cdaf-4d37-a4f0-db998fd09ec4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:29:59.444432 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 21/51] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:59 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1270 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:29:59.453798 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-53d116c4-cdaf-4d37-a4f0-db998fd09ec4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:59.455018 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-53d116c4-cdaf-4d37-a4f0-db998fd09ec4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:59.456295 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-53d116c4-cdaf-4d37-a4f0-db998fd09ec4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:29:59.456891 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-53d116c4-cdaf-4d37-a4f0-db998fd09ec4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:29:59.523060 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-53d116c4-cdaf-4d37-a4f0-db998fd09ec4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:29:59.531021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-53d116c4-cdaf-4d37-a4f0-db998fd09ec4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1240 microversion: 2.1 time: 0.092782 Aug 13 04:29:59.531767 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 31/52] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:29:59 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1240 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:29:59.574887 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-da555fb7-10bb-402f-baf0-135c3e423a4a tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46d2a5280>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:29:59.607033 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-da555fb7-10bb-402f-baf0-135c3e423a4a tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 200 len: 286 microversion: 2.1 time: 0.036566 Aug 13 04:29:59.611474 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 22/53] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Aug 13 04:29:59 2021] GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 286 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:30:00.004468 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1881194437", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "961a975f-b6bf-4b12-8622-52a8bd477fc6"}], "security_groups": [{"name": "tempest-securitygroup--858733869"}], "key_name": "tempest-keypair-1951400845", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:00.119216 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.network.neutron [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] validate_networks() for [('961a975f-b6bf-4b12-8622-52a8bd477fc6', None, None, None)] {{(pid=108287) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:30:00.214648 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-98c8d8d7-6163-45b7-a367-6dcdf117acd9 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46d1feb80>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:00.297367 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-98c8d8d7-6163-45b7-a367-6dcdf117acd9 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 200 len: 353 microversion: 2.1 time: 0.087603 Aug 13 04:30:00.297981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 23/54] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:30:00 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 353 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:30:00.323945 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9a187c4f-cb2a-4e1d-8791-f7e1bee6b885 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:00.324855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9a187c4f-cb2a-4e1d-8791-f7e1bee6b885 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:00.338894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9a187c4f-cb2a-4e1d-8791-f7e1bee6b885 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:00.339348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9a187c4f-cb2a-4e1d-8791-f7e1bee6b885 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:00.341264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9a187c4f-cb2a-4e1d-8791-f7e1bee6b885 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:00.341763 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9a187c4f-cb2a-4e1d-8791-f7e1bee6b885 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:00.434578 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9a187c4f-cb2a-4e1d-8791-f7e1bee6b885 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:00.443015 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9a187c4f-cb2a-4e1d-8791-f7e1bee6b885 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1210 microversion: 2.1 time: 0.126752 Aug 13 04:30:00.452878 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 24/55] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:00 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1210 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:00.461768 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a1f42fe3-0021-48ad-90a4-8cfed3d8535f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:00.463172 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a1f42fe3-0021-48ad-90a4-8cfed3d8535f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:00.469154 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a1f42fe3-0021-48ad-90a4-8cfed3d8535f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:00.469706 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a1f42fe3-0021-48ad-90a4-8cfed3d8535f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:00.470758 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a1f42fe3-0021-48ad-90a4-8cfed3d8535f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:00.471197 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a1f42fe3-0021-48ad-90a4-8cfed3d8535f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:00.572280 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a1f42fe3-0021-48ad-90a4-8cfed3d8535f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:00.599775 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a1f42fe3-0021-48ad-90a4-8cfed3d8535f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1270 microversion: 2.1 time: 0.140339 Aug 13 04:30:00.601718 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 25/56] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:00 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1270 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:00.613548 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5d507259-e84d-4a21-b082-88ae1b0cc612 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:00.615773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5d507259-e84d-4a21-b082-88ae1b0cc612 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:00.630912 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d507259-e84d-4a21-b082-88ae1b0cc612 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:00.635450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Flavor limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:30:00.635989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d507259-e84d-4a21-b082-88ae1b0cc612 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:00.636434 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d507259-e84d-4a21-b082-88ae1b0cc612 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:00.636966 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Image limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:30:00.637642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Flavor pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:30:00.638456 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Image pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:30:00.638856 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d507259-e84d-4a21-b082-88ae1b0cc612 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:00.639100 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:30:00.688007 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:00.688007 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:00.688007 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:00.688007 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:00.726898 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for project 97bcef962215442fa34d9ef949492fc4. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:30:00.750938 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for user 79f213e02f8d44e789aae985fa15d58f and project 97bcef962215442fa34d9ef949492fc4. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:30:00.787874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Going to run 1 instances... {{(pid=108287) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:30:00.806315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:30:00.918966 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-02a902ef-5468-49f9-9f5f-8554d3dd5764 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.918686 Aug 13 04:30:00.924404 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 32/57] 10.222.0.13 () {62 vars in 1188 bytes} [Fri Aug 13 04:29:59 2021] POST /compute/v2.1/servers => generated 401 bytes in 925 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Aug 13 04:30:00.931304 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-80a93bb1-356f-4f61-9bdf-4188e8ce2dbd tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46ca1ef70>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:00.988314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-80a93bb1-356f-4f61-9bdf-4188e8ce2dbd tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] HTTP exception thrown: Snapshot 671c383d-e803-4abc-af89-09ecdb6f009f could not be found. Aug 13 04:30:00.989045 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-80a93bb1-356f-4f61-9bdf-4188e8ce2dbd tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Returning 404 to user: Snapshot 671c383d-e803-4abc-af89-09ecdb6f009f could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:30:00.990107 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-80a93bb1-356f-4f61-9bdf-4188e8ce2dbd tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f" status: 404 len: 111 microversion: 2.1 time: 0.064246 Aug 13 04:30:00.994387 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 33/58] 10.222.0.13 () {58 vars in 1251 bytes} [Fri Aug 13 04:30:00 2021] GET /compute/v2.1/os-snapshots/671c383d-e803-4abc-af89-09ecdb6f009f => generated 111 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:30:00.997189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-db802887-668b-48a3-bca5-393ffb53b53d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:01.009936 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-db802887-668b-48a3-bca5-393ffb53b53d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:01.093677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5d507259-e84d-4a21-b082-88ae1b0cc612 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:01.093677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5d507259-e84d-4a21-b082-88ae1b0cc612 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1232 microversion: 2.1 time: 0.486844 Aug 13 04:30:01.093677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 26/59] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:00 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1232 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:01.098839 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1004fa5f-8c40-4742-942d-f4a28f5a3b12 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46d328ee0>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:01.140591 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-db802887-668b-48a3-bca5-393ffb53b53d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:01.150962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-db802887-668b-48a3-bca5-393ffb53b53d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:01.152640 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-db802887-668b-48a3-bca5-393ffb53b53d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:01.163580 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-db802887-668b-48a3-bca5-393ffb53b53d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1282 microversion: 2.20 time: 0.161723 Aug 13 04:30:01.164249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 34/60] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:00 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1282 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:01.310695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9e0c7889-ed43-470a-b103-3b5147cc81e7 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Calling method '.version_select at 0x7fc46ca77160>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:01.320412 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1004fa5f-8c40-4742-942d-f4a28f5a3b12 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e" status: 202 len: 0 microversion: 2.1 time: 0.225100 Aug 13 04:30:01.321818 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 27/61] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Aug 13 04:30:01 2021] DELETE /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:30:01.334681 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4ca0743a-90bf-4588-853d-24ea6e566918 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46d203f70>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:01.393170 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-9e0c7889-ed43-470a-b103-3b5147cc81e7 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] HTTP exception thrown: Volume 51c25f7f-6340-416b-af5c-c3a70e943618 could not be found. Aug 13 04:30:01.393860 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9e0c7889-ed43-470a-b103-3b5147cc81e7 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] Returning 404 to user: Volume 51c25f7f-6340-416b-af5c-c3a70e943618 could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:30:01.395639 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9e0c7889-ed43-470a-b103-3b5147cc81e7 tempest-VolumesGetTestJSON-1074876651 tempest-VolumesGetTestJSON-1074876651-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618" status: 404 len: 109 microversion: 2.1 time: 0.089324 Aug 13 04:30:01.398127 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 35/62] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:30:01 2021] GET /compute/v2.1/os-volumes/51c25f7f-6340-416b-af5c-c3a70e943618 => generated 109 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:30:01.465190 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ece2c174-f3c7-44ba-84db-91c8c4287b9c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:01.466074 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ece2c174-f3c7-44ba-84db-91c8c4287b9c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:01.472074 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4ca0743a-90bf-4588-853d-24ea6e566918 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e" status: 200 len: 345 microversion: 2.1 time: 0.146201 Aug 13 04:30:01.473734 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 28/63] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:30:01 2021] GET /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e => generated 345 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:30:01.497921 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ece2c174-f3c7-44ba-84db-91c8c4287b9c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:01.498519 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ece2c174-f3c7-44ba-84db-91c8c4287b9c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:01.500330 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ece2c174-f3c7-44ba-84db-91c8c4287b9c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:01.501532 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ece2c174-f3c7-44ba-84db-91c8c4287b9c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:01.627810 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b812b17e-936d-4c48-a75a-7f0179bfb5ff tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:01.628462 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b812b17e-936d-4c48-a75a-7f0179bfb5ff tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:01.655253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b812b17e-936d-4c48-a75a-7f0179bfb5ff tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:01.655710 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b812b17e-936d-4c48-a75a-7f0179bfb5ff tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:01.656504 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b812b17e-936d-4c48-a75a-7f0179bfb5ff tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:01.663729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b812b17e-936d-4c48-a75a-7f0179bfb5ff tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:02.079832 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ece2c174-f3c7-44ba-84db-91c8c4287b9c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:02.091899 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ece2c174-f3c7-44ba-84db-91c8c4287b9c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1272 microversion: 2.1 time: 0.629627 Aug 13 04:30:02.092534 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 36/64] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:01 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1272 bytes in 637 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:02.114923 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6156c409-fa32-447f-b56c-367f3624f1b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:02.115864 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6156c409-fa32-447f-b56c-367f3624f1b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:02.130898 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6156c409-fa32-447f-b56c-367f3624f1b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:02.131602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6156c409-fa32-447f-b56c-367f3624f1b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:02.132708 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6156c409-fa32-447f-b56c-367f3624f1b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:02.133298 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6156c409-fa32-447f-b56c-367f3624f1b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:02.386041 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b812b17e-936d-4c48-a75a-7f0179bfb5ff tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:02.396863 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b812b17e-936d-4c48-a75a-7f0179bfb5ff tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1276 microversion: 2.1 time: 0.781777 Aug 13 04:30:02.400329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 29/65] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:01 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1276 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:02.413271 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-726bdb56-d3e9-4e9b-95fc-13ffabc01d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:02.414840 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-726bdb56-d3e9-4e9b-95fc-13ffabc01d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:02.433651 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6156c409-fa32-447f-b56c-367f3624f1b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:02.442819 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-726bdb56-d3e9-4e9b-95fc-13ffabc01d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:02.448605 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-726bdb56-d3e9-4e9b-95fc-13ffabc01d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:02.449573 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-726bdb56-d3e9-4e9b-95fc-13ffabc01d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:02.452871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6156c409-fa32-447f-b56c-367f3624f1b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1294 microversion: 2.1 time: 0.347337 Aug 13 04:30:02.456297 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 37/66] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:02 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1294 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:02.456789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-726bdb56-d3e9-4e9b-95fc-13ffabc01d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:02.490984 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-21535f17-d77c-4fa0-a537-c4f999144f86 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46c9e5dc0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:02.560743 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-21535f17-d77c-4fa0-a537-c4f999144f86 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] HTTP exception thrown: Volume d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e could not be found. Aug 13 04:30:02.561950 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-21535f17-d77c-4fa0-a537-c4f999144f86 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Returning 404 to user: Volume d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:30:02.563109 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-21535f17-d77c-4fa0-a537-c4f999144f86 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e" status: 404 len: 109 microversion: 2.1 time: 0.076350 Aug 13 04:30:02.573392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 38/67] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:30:02 2021] GET /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e => generated 109 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:30:02.585352 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e410682d-f35f-4068-a784-cf36891333e3 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46cac5d30>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:02.691715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-e410682d-f35f-4068-a784-cf36891333e3 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] HTTP exception thrown: Volume d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e could not be found. Aug 13 04:30:02.692423 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e410682d-f35f-4068-a784-cf36891333e3 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Returning 404 to user: Volume d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:30:02.693319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e410682d-f35f-4068-a784-cf36891333e3 tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e" status: 404 len: 109 microversion: 2.1 time: 0.117495 Aug 13 04:30:02.693909 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 39/68] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Aug 13 04:30:02 2021] DELETE /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e => generated 109 bytes in 119 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:30:02.702991 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0163592d-d193-4973-8016-d01b3b8f6d3c tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Calling method '.version_select at 0x7fc46c9e59d0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:02.746414 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-0163592d-d193-4973-8016-d01b3b8f6d3c tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] HTTP exception thrown: Volume d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e could not be found. Aug 13 04:30:02.747285 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0163592d-d193-4973-8016-d01b3b8f6d3c tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] Returning 404 to user: Volume d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:30:02.748685 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0163592d-d193-4973-8016-d01b3b8f6d3c tempest-VolumesSnapshotsTestJSON-940580053 tempest-VolumesSnapshotsTestJSON-940580053-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e" status: 404 len: 109 microversion: 2.1 time: 0.049551 Aug 13 04:30:02.761649 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 40/69] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:30:02 2021] GET /compute/v2.1/os-volumes/d07af92a-dfbd-4b66-8baa-8c4a25b1bc0e => generated 109 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:30:03.004177 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-726bdb56-d3e9-4e9b-95fc-13ffabc01d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:03.018040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-726bdb56-d3e9-4e9b-95fc-13ffabc01d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:03.030424 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-726bdb56-d3e9-4e9b-95fc-13ffabc01d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:03.033567 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-726bdb56-d3e9-4e9b-95fc-13ffabc01d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1334 microversion: 2.20 time: 0.628360 Aug 13 04:30:03.041779 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 30/70] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:02 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1334 bytes in 640 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:03.114323 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-866f4c93-3341-4449-9b35-af2a7825f4c2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:03.114953 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-866f4c93-3341-4449-9b35-af2a7825f4c2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:03.149126 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-866f4c93-3341-4449-9b35-af2a7825f4c2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:03.150494 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-866f4c93-3341-4449-9b35-af2a7825f4c2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:03.155592 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-866f4c93-3341-4449-9b35-af2a7825f4c2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:03.157619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-866f4c93-3341-4449-9b35-af2a7825f4c2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:03.418455 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-83929c40-09b2-4310-9ec4-1d5b506f79ba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:03.419136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-83929c40-09b2-4310-9ec4-1d5b506f79ba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:03.429640 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-83929c40-09b2-4310-9ec4-1d5b506f79ba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:03.436231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-83929c40-09b2-4310-9ec4-1d5b506f79ba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:03.439614 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-83929c40-09b2-4310-9ec4-1d5b506f79ba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:03.440069 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-83929c40-09b2-4310-9ec4-1d5b506f79ba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:03.487551 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-866f4c93-3341-4449-9b35-af2a7825f4c2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:03.496231 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-866f4c93-3341-4449-9b35-af2a7825f4c2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1272 microversion: 2.1 time: 0.388219 Aug 13 04:30:03.500250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 41/71] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:03 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1272 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:03.506602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e7a472c6-1a20-472b-9ded-0b2e9e0908c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:03.511650 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e7a472c6-1a20-472b-9ded-0b2e9e0908c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:03.529688 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e7a472c6-1a20-472b-9ded-0b2e9e0908c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:03.531241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e7a472c6-1a20-472b-9ded-0b2e9e0908c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:03.533186 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e7a472c6-1a20-472b-9ded-0b2e9e0908c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:03.533875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e7a472c6-1a20-472b-9ded-0b2e9e0908c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:03.784761 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e7a472c6-1a20-472b-9ded-0b2e9e0908c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:03.804670 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e7a472c6-1a20-472b-9ded-0b2e9e0908c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1294 microversion: 2.1 time: 0.292673 Aug 13 04:30:03.806502 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 42/72] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:03 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1294 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:04.053476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-83929c40-09b2-4310-9ec4-1d5b506f79ba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:04.057513 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-04e7fd42-fc3a-41a8-b396-c1e7880e2b0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:04.058882 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-04e7fd42-fc3a-41a8-b396-c1e7880e2b0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:04.076187 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-83929c40-09b2-4310-9ec4-1d5b506f79ba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.663036 Aug 13 04:30:04.082178 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04e7fd42-fc3a-41a8-b396-c1e7880e2b0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:04.082178 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04e7fd42-fc3a-41a8-b396-c1e7880e2b0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:04.082383 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 31/73] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:03 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:04.087474 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04e7fd42-fc3a-41a8-b396-c1e7880e2b0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:04.089239 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04e7fd42-fc3a-41a8-b396-c1e7880e2b0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:04.208941 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-04e7fd42-fc3a-41a8-b396-c1e7880e2b0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:04.234417 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-04e7fd42-fc3a-41a8-b396-c1e7880e2b0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:04.238431 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-04e7fd42-fc3a-41a8-b396-c1e7880e2b0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:04.241017 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-04e7fd42-fc3a-41a8-b396-c1e7880e2b0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1334 microversion: 2.20 time: 0.191923 Aug 13 04:30:04.242329 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 43/74] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:04 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1334 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:04.518123 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bd4bf68a-6c5c-49ef-8600-2d1021f0b248 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:04.519012 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bd4bf68a-6c5c-49ef-8600-2d1021f0b248 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:04.527264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd4bf68a-6c5c-49ef-8600-2d1021f0b248 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:04.530322 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd4bf68a-6c5c-49ef-8600-2d1021f0b248 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:04.531499 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd4bf68a-6c5c-49ef-8600-2d1021f0b248 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:04.532643 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd4bf68a-6c5c-49ef-8600-2d1021f0b248 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:04.759503 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bd4bf68a-6c5c-49ef-8600-2d1021f0b248 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:04.792975 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bd4bf68a-6c5c-49ef-8600-2d1021f0b248 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.274930 Aug 13 04:30:04.794451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 32/75] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:04 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:04.823450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-20a546c7-b6f7-4e84-a883-0898a9562a03 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:04.824064 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-20a546c7-b6f7-4e84-a883-0898a9562a03 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:04.838774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20a546c7-b6f7-4e84-a883-0898a9562a03 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:04.839224 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20a546c7-b6f7-4e84-a883-0898a9562a03 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:04.840008 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20a546c7-b6f7-4e84-a883-0898a9562a03 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:04.840505 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20a546c7-b6f7-4e84-a883-0898a9562a03 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:05.096269 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e6b1bb4c-72a0-4113-8377-92dc14fadb11 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:05.097102 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e6b1bb4c-72a0-4113-8377-92dc14fadb11 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:05.107721 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e6b1bb4c-72a0-4113-8377-92dc14fadb11 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:05.108248 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e6b1bb4c-72a0-4113-8377-92dc14fadb11 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:05.109110 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e6b1bb4c-72a0-4113-8377-92dc14fadb11 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:05.110148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e6b1bb4c-72a0-4113-8377-92dc14fadb11 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:05.139814 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-20a546c7-b6f7-4e84-a883-0898a9562a03 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:05.151615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-20a546c7-b6f7-4e84-a883-0898a9562a03 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.332321 Aug 13 04:30:05.154524 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 44/76] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:04 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:05.260440 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f990da9e-9ca3-42c6-b177-6d1894152f00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:05.261193 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f990da9e-9ca3-42c6-b177-6d1894152f00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:05.267704 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f990da9e-9ca3-42c6-b177-6d1894152f00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:05.270766 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f990da9e-9ca3-42c6-b177-6d1894152f00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:05.273476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f990da9e-9ca3-42c6-b177-6d1894152f00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:05.274841 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f990da9e-9ca3-42c6-b177-6d1894152f00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:05.381057 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f990da9e-9ca3-42c6-b177-6d1894152f00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:05.389260 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f990da9e-9ca3-42c6-b177-6d1894152f00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:05.394735 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f990da9e-9ca3-42c6-b177-6d1894152f00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:05.394963 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e6b1bb4c-72a0-4113-8377-92dc14fadb11 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:05.397333 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f990da9e-9ca3-42c6-b177-6d1894152f00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1334 microversion: 2.20 time: 0.141404 Aug 13 04:30:05.400281 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 45/77] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:05 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1334 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:30:05.407470 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e6b1bb4c-72a0-4113-8377-92dc14fadb11 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.313356 Aug 13 04:30:05.408065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 33/78] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:05 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:05.810826 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7cf30725-1d46-410b-a2b3-e19eeb219659 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:05.811813 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7cf30725-1d46-410b-a2b3-e19eeb219659 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:05.829106 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7cf30725-1d46-410b-a2b3-e19eeb219659 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:05.831843 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7cf30725-1d46-410b-a2b3-e19eeb219659 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:05.834280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7cf30725-1d46-410b-a2b3-e19eeb219659 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:05.834883 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7cf30725-1d46-410b-a2b3-e19eeb219659 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:06.115713 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7cf30725-1d46-410b-a2b3-e19eeb219659 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:06.127769 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7cf30725-1d46-410b-a2b3-e19eeb219659 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.320361 Aug 13 04:30:06.128539 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 46/79] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:05 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:06.171981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ca7905b0-359b-4586-82ab-449b4ccfb779 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:06.173121 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ca7905b0-359b-4586-82ab-449b4ccfb779 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:06.180959 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ca7905b0-359b-4586-82ab-449b4ccfb779 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:06.183343 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ca7905b0-359b-4586-82ab-449b4ccfb779 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:06.184392 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ca7905b0-359b-4586-82ab-449b4ccfb779 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:06.184827 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ca7905b0-359b-4586-82ab-449b4ccfb779 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:06.421721 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-01fc230f-7acc-4a31-a134-fc3c1c81e98a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:06.423420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-01fc230f-7acc-4a31-a134-fc3c1c81e98a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:06.433974 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01fc230f-7acc-4a31-a134-fc3c1c81e98a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:06.434825 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01fc230f-7acc-4a31-a134-fc3c1c81e98a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:06.436065 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01fc230f-7acc-4a31-a134-fc3c1c81e98a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:06.436647 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01fc230f-7acc-4a31-a134-fc3c1c81e98a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:06.551791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-01fc230f-7acc-4a31-a134-fc3c1c81e98a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:06.559963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-01fc230f-7acc-4a31-a134-fc3c1c81e98a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:06.561498 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-01fc230f-7acc-4a31-a134-fc3c1c81e98a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:06.562596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-01fc230f-7acc-4a31-a134-fc3c1c81e98a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.148224 Aug 13 04:30:06.580609 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 47/80] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:06 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:30:06.585636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-427ad261-35e4-4b61-a9ca-8d6a50d5096d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:06.589473 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-427ad261-35e4-4b61-a9ca-8d6a50d5096d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:06.597636 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ca7905b0-359b-4586-82ab-449b4ccfb779 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:06.605418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ca7905b0-359b-4586-82ab-449b4ccfb779 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.437372 Aug 13 04:30:06.608727 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 34/81] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:06 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:06.625856 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-427ad261-35e4-4b61-a9ca-8d6a50d5096d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:06.626672 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-427ad261-35e4-4b61-a9ca-8d6a50d5096d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:06.627632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-427ad261-35e4-4b61-a9ca-8d6a50d5096d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:06.628074 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-427ad261-35e4-4b61-a9ca-8d6a50d5096d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:06.793980 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-427ad261-35e4-4b61-a9ca-8d6a50d5096d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:06.804544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-427ad261-35e4-4b61-a9ca-8d6a50d5096d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.222357 Aug 13 04:30:06.805053 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 48/82] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:06 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:07.144216 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2ea1878b-835f-476b-8b1b-2a564d7e99ba tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:07.144975 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2ea1878b-835f-476b-8b1b-2a564d7e99ba tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:07.151538 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ea1878b-835f-476b-8b1b-2a564d7e99ba tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:07.152256 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ea1878b-835f-476b-8b1b-2a564d7e99ba tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:07.153633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ea1878b-835f-476b-8b1b-2a564d7e99ba tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:07.154377 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ea1878b-835f-476b-8b1b-2a564d7e99ba tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:07.384843 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2ea1878b-835f-476b-8b1b-2a564d7e99ba tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:07.393862 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2ea1878b-835f-476b-8b1b-2a564d7e99ba tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.253262 Aug 13 04:30:07.394993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 35/83] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:07 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:07.589992 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-68b9ea0f-300b-4822-9577-711f29d77ce2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:07.590729 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-68b9ea0f-300b-4822-9577-711f29d77ce2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:07.606716 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68b9ea0f-300b-4822-9577-711f29d77ce2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:07.607383 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68b9ea0f-300b-4822-9577-711f29d77ce2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:07.608695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68b9ea0f-300b-4822-9577-711f29d77ce2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:07.609497 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68b9ea0f-300b-4822-9577-711f29d77ce2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:07.624466 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b349a72e-e8f3-42d4-a7b7-91055ba6193b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:07.639613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b349a72e-e8f3-42d4-a7b7-91055ba6193b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:07.651701 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b349a72e-e8f3-42d4-a7b7-91055ba6193b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:07.652338 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b349a72e-e8f3-42d4-a7b7-91055ba6193b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:07.656283 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b349a72e-e8f3-42d4-a7b7-91055ba6193b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:07.657005 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b349a72e-e8f3-42d4-a7b7-91055ba6193b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:07.743797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-68b9ea0f-300b-4822-9577-711f29d77ce2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:07.756125 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-68b9ea0f-300b-4822-9577-711f29d77ce2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:07.757865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-68b9ea0f-300b-4822-9577-711f29d77ce2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:07.766768 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-68b9ea0f-300b-4822-9577-711f29d77ce2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.182187 Aug 13 04:30:07.767935 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 49/84] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:07 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:07.825305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e608eff4-4a24-4ca3-adc0-1ad670cea37a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:07.826255 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e608eff4-4a24-4ca3-adc0-1ad670cea37a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:07.833871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e608eff4-4a24-4ca3-adc0-1ad670cea37a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:07.834705 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e608eff4-4a24-4ca3-adc0-1ad670cea37a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:07.835636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e608eff4-4a24-4ca3-adc0-1ad670cea37a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:07.836276 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e608eff4-4a24-4ca3-adc0-1ad670cea37a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:07.948878 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b349a72e-e8f3-42d4-a7b7-91055ba6193b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:07.960628 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b349a72e-e8f3-42d4-a7b7-91055ba6193b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.339478 Aug 13 04:30:07.963498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 36/85] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:07 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:08.027247 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e608eff4-4a24-4ca3-adc0-1ad670cea37a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:08.034488 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e608eff4-4a24-4ca3-adc0-1ad670cea37a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.215085 Aug 13 04:30:08.044102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 50/86] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:07 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:08.412256 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-178a681d-7bbb-4138-9686-31121ca806cf tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:08.412829 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-178a681d-7bbb-4138-9686-31121ca806cf tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:08.425178 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-178a681d-7bbb-4138-9686-31121ca806cf tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:08.425918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-178a681d-7bbb-4138-9686-31121ca806cf tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:08.426716 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-178a681d-7bbb-4138-9686-31121ca806cf tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:08.429807 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-178a681d-7bbb-4138-9686-31121ca806cf tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:08.608337 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-178a681d-7bbb-4138-9686-31121ca806cf tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:08.618479 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-178a681d-7bbb-4138-9686-31121ca806cf tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.209749 Aug 13 04:30:08.624558 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 37/87] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:08 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:08.787633 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3b1c1fae-ccc1-4044-ac5b-5b213b307c7d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:08.788441 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3b1c1fae-ccc1-4044-ac5b-5b213b307c7d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:08.800540 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b1c1fae-ccc1-4044-ac5b-5b213b307c7d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:08.801015 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b1c1fae-ccc1-4044-ac5b-5b213b307c7d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:08.801819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b1c1fae-ccc1-4044-ac5b-5b213b307c7d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:08.802251 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b1c1fae-ccc1-4044-ac5b-5b213b307c7d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:08.923461 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3b1c1fae-ccc1-4044-ac5b-5b213b307c7d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:08.932761 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3b1c1fae-ccc1-4044-ac5b-5b213b307c7d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:08.935293 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3b1c1fae-ccc1-4044-ac5b-5b213b307c7d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:08.936578 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3b1c1fae-ccc1-4044-ac5b-5b213b307c7d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.154106 Aug 13 04:30:08.948445 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 51/88] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:08 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:08.982555 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5239ca6a-57cf-4761-8f65-f83b93d2dd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:08.983508 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5239ca6a-57cf-4761-8f65-f83b93d2dd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:08.994693 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5239ca6a-57cf-4761-8f65-f83b93d2dd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:08.997167 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5239ca6a-57cf-4761-8f65-f83b93d2dd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:08.999789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5239ca6a-57cf-4761-8f65-f83b93d2dd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:09.001841 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5239ca6a-57cf-4761-8f65-f83b93d2dd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:09.053614 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-18d01aff-1bb8-416b-9d95-5790630e9f69 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:09.054465 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-18d01aff-1bb8-416b-9d95-5790630e9f69 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:09.066925 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-18d01aff-1bb8-416b-9d95-5790630e9f69 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:09.067937 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-18d01aff-1bb8-416b-9d95-5790630e9f69 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:09.077340 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-18d01aff-1bb8-416b-9d95-5790630e9f69 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:09.077943 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-18d01aff-1bb8-416b-9d95-5790630e9f69 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:09.358133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5239ca6a-57cf-4761-8f65-f83b93d2dd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:09.368827 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5239ca6a-57cf-4761-8f65-f83b93d2dd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.389369 Aug 13 04:30:09.369496 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 38/89] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:08 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:09.377046 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-18d01aff-1bb8-416b-9d95-5790630e9f69 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:09.385050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-18d01aff-1bb8-416b-9d95-5790630e9f69 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.337215 Aug 13 04:30:09.398154 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 52/90] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:09 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:09.635911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8fa9b763-c60e-4939-bb96-e3b9dbce1fd6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:09.637367 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8fa9b763-c60e-4939-bb96-e3b9dbce1fd6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:09.646526 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8fa9b763-c60e-4939-bb96-e3b9dbce1fd6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:09.647289 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8fa9b763-c60e-4939-bb96-e3b9dbce1fd6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:09.648350 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8fa9b763-c60e-4939-bb96-e3b9dbce1fd6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:09.649012 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8fa9b763-c60e-4939-bb96-e3b9dbce1fd6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:09.795991 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-8fa9b763-c60e-4939-bb96-e3b9dbce1fd6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:09.804164 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8fa9b763-c60e-4939-bb96-e3b9dbce1fd6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.172449 Aug 13 04:30:09.804872 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 39/91] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:09 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:09.956315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2aac6dc1-5778-4b1a-b6db-0dc515ee57ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:09.956907 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2aac6dc1-5778-4b1a-b6db-0dc515ee57ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:09.966904 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2aac6dc1-5778-4b1a-b6db-0dc515ee57ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:09.967359 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2aac6dc1-5778-4b1a-b6db-0dc515ee57ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:09.969942 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2aac6dc1-5778-4b1a-b6db-0dc515ee57ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:09.970420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2aac6dc1-5778-4b1a-b6db-0dc515ee57ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:10.080146 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2aac6dc1-5778-4b1a-b6db-0dc515ee57ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:10.089739 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2aac6dc1-5778-4b1a-b6db-0dc515ee57ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:10.091264 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2aac6dc1-5778-4b1a-b6db-0dc515ee57ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:10.092364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2aac6dc1-5778-4b1a-b6db-0dc515ee57ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.140649 Aug 13 04:30:10.102590 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 53/92] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:09 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:10.386295 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d5035c15-75eb-43aa-b865-0f4219d5dc0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:10.387114 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d5035c15-75eb-43aa-b865-0f4219d5dc0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:10.393662 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d5035c15-75eb-43aa-b865-0f4219d5dc0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:10.394115 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d5035c15-75eb-43aa-b865-0f4219d5dc0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:10.394911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d5035c15-75eb-43aa-b865-0f4219d5dc0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:10.395349 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d5035c15-75eb-43aa-b865-0f4219d5dc0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:10.405766 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-dc1ada13-c34a-4e12-81e5-f333bfc45812 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:10.406769 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-dc1ada13-c34a-4e12-81e5-f333bfc45812 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:10.413798 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc1ada13-c34a-4e12-81e5-f333bfc45812 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:10.414446 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc1ada13-c34a-4e12-81e5-f333bfc45812 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:10.415789 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc1ada13-c34a-4e12-81e5-f333bfc45812 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:10.416409 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc1ada13-c34a-4e12-81e5-f333bfc45812 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:10.592271 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d5035c15-75eb-43aa-b865-0f4219d5dc0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:10.599872 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d5035c15-75eb-43aa-b865-0f4219d5dc0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.218001 Aug 13 04:30:10.612234 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 40/93] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:10 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:10.637695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dc1ada13-c34a-4e12-81e5-f333bfc45812 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:10.653786 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dc1ada13-c34a-4e12-81e5-f333bfc45812 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.250229 Aug 13 04:30:10.655636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 54/94] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:10 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:10.822380 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5cbfcd4e-1b7b-4e78-bed4-701dbdbdec2f tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:10.822965 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5cbfcd4e-1b7b-4e78-bed4-701dbdbdec2f tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:10.829359 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5cbfcd4e-1b7b-4e78-bed4-701dbdbdec2f tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:10.829828 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5cbfcd4e-1b7b-4e78-bed4-701dbdbdec2f tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:10.830598 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5cbfcd4e-1b7b-4e78-bed4-701dbdbdec2f tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:10.831022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5cbfcd4e-1b7b-4e78-bed4-701dbdbdec2f tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:10.963470 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5cbfcd4e-1b7b-4e78-bed4-701dbdbdec2f tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:10.972140 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5cbfcd4e-1b7b-4e78-bed4-701dbdbdec2f tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.153710 Aug 13 04:30:10.972712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 41/95] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:10 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:11.111219 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-585a14b9-394f-45e1-ab7b-4250be1a082e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:11.111841 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-585a14b9-394f-45e1-ab7b-4250be1a082e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:11.119331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-585a14b9-394f-45e1-ab7b-4250be1a082e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:11.120111 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-585a14b9-394f-45e1-ab7b-4250be1a082e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:11.121196 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-585a14b9-394f-45e1-ab7b-4250be1a082e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:11.121827 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-585a14b9-394f-45e1-ab7b-4250be1a082e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:11.241083 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-585a14b9-394f-45e1-ab7b-4250be1a082e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:11.250394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-585a14b9-394f-45e1-ab7b-4250be1a082e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:11.254896 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-585a14b9-394f-45e1-ab7b-4250be1a082e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:11.258889 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-585a14b9-394f-45e1-ab7b-4250be1a082e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.151530 Aug 13 04:30:11.261716 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 55/96] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:11 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:11.619955 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bd697ce5-b25e-4920-9e7b-93d86a0b079b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:11.628759 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bd697ce5-b25e-4920-9e7b-93d86a0b079b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:11.635109 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd697ce5-b25e-4920-9e7b-93d86a0b079b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:11.635489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd697ce5-b25e-4920-9e7b-93d86a0b079b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:11.636263 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd697ce5-b25e-4920-9e7b-93d86a0b079b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:11.636684 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd697ce5-b25e-4920-9e7b-93d86a0b079b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:11.674877 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f5846726-a19d-43e5-a7db-8ed705e68e16 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:11.675976 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f5846726-a19d-43e5-a7db-8ed705e68e16 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:11.683704 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f5846726-a19d-43e5-a7db-8ed705e68e16 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:11.686104 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f5846726-a19d-43e5-a7db-8ed705e68e16 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:11.687188 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f5846726-a19d-43e5-a7db-8ed705e68e16 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:11.687708 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f5846726-a19d-43e5-a7db-8ed705e68e16 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:11.871469 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bd697ce5-b25e-4920-9e7b-93d86a0b079b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:11.882152 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bd697ce5-b25e-4920-9e7b-93d86a0b079b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.265863 Aug 13 04:30:11.883642 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 42/97] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:11 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:11.893329 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f5846726-a19d-43e5-a7db-8ed705e68e16 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:11.901886 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f5846726-a19d-43e5-a7db-8ed705e68e16 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.231702 Aug 13 04:30:11.902464 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 56/98] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:11 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:11.991048 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7aa8b2e0-1c36-423d-9d74-7ca2e0317dde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:11.991661 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7aa8b2e0-1c36-423d-9d74-7ca2e0317dde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:12.000781 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7aa8b2e0-1c36-423d-9d74-7ca2e0317dde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:12.001124 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7aa8b2e0-1c36-423d-9d74-7ca2e0317dde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:12.006035 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7aa8b2e0-1c36-423d-9d74-7ca2e0317dde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:12.006485 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7aa8b2e0-1c36-423d-9d74-7ca2e0317dde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:12.147792 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7aa8b2e0-1c36-423d-9d74-7ca2e0317dde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:12.155687 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7aa8b2e0-1c36-423d-9d74-7ca2e0317dde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.169260 Aug 13 04:30:12.156098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 43/99] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:11 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:12.279709 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-01b16b72-6e57-49fc-be51-c1abf487834c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:12.281052 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-01b16b72-6e57-49fc-be51-c1abf487834c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:12.287509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01b16b72-6e57-49fc-be51-c1abf487834c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:12.288044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01b16b72-6e57-49fc-be51-c1abf487834c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:12.288864 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01b16b72-6e57-49fc-be51-c1abf487834c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:12.289352 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01b16b72-6e57-49fc-be51-c1abf487834c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:12.366255 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-01b16b72-6e57-49fc-be51-c1abf487834c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:12.375615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-01b16b72-6e57-49fc-be51-c1abf487834c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:12.377259 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-01b16b72-6e57-49fc-be51-c1abf487834c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:12.378548 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-01b16b72-6e57-49fc-be51-c1abf487834c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.102744 Aug 13 04:30:12.390203 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 57/100] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:12 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:12.901231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2c548f86-7a4f-4c62-9064-2b8406cc3385 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:12.902656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2c548f86-7a4f-4c62-9064-2b8406cc3385 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:12.909215 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c548f86-7a4f-4c62-9064-2b8406cc3385 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:12.910116 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c548f86-7a4f-4c62-9064-2b8406cc3385 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:12.911206 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c548f86-7a4f-4c62-9064-2b8406cc3385 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:12.911947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c548f86-7a4f-4c62-9064-2b8406cc3385 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:12.921005 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5ef6cf62-b670-44d1-b71b-0d9a79c22627 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:12.921652 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5ef6cf62-b670-44d1-b71b-0d9a79c22627 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:12.927718 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5ef6cf62-b670-44d1-b71b-0d9a79c22627 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:12.928170 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5ef6cf62-b670-44d1-b71b-0d9a79c22627 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:12.929015 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5ef6cf62-b670-44d1-b71b-0d9a79c22627 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:12.939102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5ef6cf62-b670-44d1-b71b-0d9a79c22627 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:13.224659 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2c548f86-7a4f-4c62-9064-2b8406cc3385 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:13.241654 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5ef6cf62-b670-44d1-b71b-0d9a79c22627 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:13.256336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2c548f86-7a4f-4c62-9064-2b8406cc3385 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.353050 Aug 13 04:30:13.260048 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 44/101] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:12 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:13.264597 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5ef6cf62-b670-44d1-b71b-0d9a79c22627 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.347758 Aug 13 04:30:13.265191 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 58/102] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:12 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:13.269143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2ff23b69-71af-4b60-ada0-9129fbcc7446 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:13.269952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2ff23b69-71af-4b60-ada0-9129fbcc7446 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:13.290547 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ff23b69-71af-4b60-ada0-9129fbcc7446 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:13.291122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ff23b69-71af-4b60-ada0-9129fbcc7446 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:13.291935 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ff23b69-71af-4b60-ada0-9129fbcc7446 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:13.296723 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ff23b69-71af-4b60-ada0-9129fbcc7446 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:13.406110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3ae711e3-b791-4aba-a137-b805499a7fa4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:13.408691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3ae711e3-b791-4aba-a137-b805499a7fa4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:13.424568 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3ae711e3-b791-4aba-a137-b805499a7fa4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:13.427209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3ae711e3-b791-4aba-a137-b805499a7fa4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:13.429050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3ae711e3-b791-4aba-a137-b805499a7fa4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:13.429933 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3ae711e3-b791-4aba-a137-b805499a7fa4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:13.561710 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3ae711e3-b791-4aba-a137-b805499a7fa4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:13.577594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3ae711e3-b791-4aba-a137-b805499a7fa4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:13.580166 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2ff23b69-71af-4b60-ada0-9129fbcc7446 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:13.580531 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3ae711e3-b791-4aba-a137-b805499a7fa4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:13.582021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3ae711e3-b791-4aba-a137-b805499a7fa4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.180336 Aug 13 04:30:13.583357 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 59/103] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:13 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:13.600276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2ff23b69-71af-4b60-ada0-9129fbcc7446 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.339006 Aug 13 04:30:13.601239 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 45/104] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:13 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:14.277135 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7ffe2adb-da5a-4a3b-98ec-3e9fa19d8427 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:14.278150 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7ffe2adb-da5a-4a3b-98ec-3e9fa19d8427 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:14.285062 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ffe2adb-da5a-4a3b-98ec-3e9fa19d8427 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:14.285986 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ffe2adb-da5a-4a3b-98ec-3e9fa19d8427 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:14.287098 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ffe2adb-da5a-4a3b-98ec-3e9fa19d8427 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:14.287864 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ffe2adb-da5a-4a3b-98ec-3e9fa19d8427 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:14.294466 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-09a0ac9c-239b-4a42-810e-39b387094d44 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:14.295262 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-09a0ac9c-239b-4a42-810e-39b387094d44 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:14.304139 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-09a0ac9c-239b-4a42-810e-39b387094d44 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:14.304379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-09a0ac9c-239b-4a42-810e-39b387094d44 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:14.305158 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-09a0ac9c-239b-4a42-810e-39b387094d44 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:14.305788 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-09a0ac9c-239b-4a42-810e-39b387094d44 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:14.577394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7ffe2adb-da5a-4a3b-98ec-3e9fa19d8427 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:14.584663 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7ffe2adb-da5a-4a3b-98ec-3e9fa19d8427 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.312615 Aug 13 04:30:14.591208 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 60/105] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:14 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:14.605374 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-14c8a1cb-201f-4039-bad8-9e179f9835e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:14.606518 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-14c8a1cb-201f-4039-bad8-9e179f9835e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:14.615318 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-09a0ac9c-239b-4a42-810e-39b387094d44 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:14.621779 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14c8a1cb-201f-4039-bad8-9e179f9835e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:14.622816 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14c8a1cb-201f-4039-bad8-9e179f9835e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:14.623387 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-09a0ac9c-239b-4a42-810e-39b387094d44 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.345581 Aug 13 04:30:14.623970 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 46/106] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:14 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:14.624173 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14c8a1cb-201f-4039-bad8-9e179f9835e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:14.624949 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14c8a1cb-201f-4039-bad8-9e179f9835e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:14.647058 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5853d04b-ea0b-457c-ba15-0acc6aebb300 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:14.647949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5853d04b-ea0b-457c-ba15-0acc6aebb300 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:14.656043 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5853d04b-ea0b-457c-ba15-0acc6aebb300 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:14.659599 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5853d04b-ea0b-457c-ba15-0acc6aebb300 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:14.659599 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5853d04b-ea0b-457c-ba15-0acc6aebb300 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:14.659599 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5853d04b-ea0b-457c-ba15-0acc6aebb300 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:14.705157 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-14c8a1cb-201f-4039-bad8-9e179f9835e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:14.714310 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-14c8a1cb-201f-4039-bad8-9e179f9835e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:14.716196 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-14c8a1cb-201f-4039-bad8-9e179f9835e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:14.717498 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-14c8a1cb-201f-4039-bad8-9e179f9835e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.116978 Aug 13 04:30:14.718514 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 61/107] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:14 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:30:14.852276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5853d04b-ea0b-457c-ba15-0acc6aebb300 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:14.860666 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5853d04b-ea0b-457c-ba15-0acc6aebb300 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.226335 Aug 13 04:30:14.861239 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 47/108] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:14 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:15.608020 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-19921a5b-9798-4849-80b7-f5df80b12a18 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:15.609396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-19921a5b-9798-4849-80b7-f5df80b12a18 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:15.618847 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-19921a5b-9798-4849-80b7-f5df80b12a18 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:15.626256 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-19921a5b-9798-4849-80b7-f5df80b12a18 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:15.627787 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-19921a5b-9798-4849-80b7-f5df80b12a18 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:15.628472 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-19921a5b-9798-4849-80b7-f5df80b12a18 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:15.652917 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-890a43b6-076d-4599-a5d3-cf8b634e6ecc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:15.653858 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-890a43b6-076d-4599-a5d3-cf8b634e6ecc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:15.665708 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-890a43b6-076d-4599-a5d3-cf8b634e6ecc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:15.666167 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-890a43b6-076d-4599-a5d3-cf8b634e6ecc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:15.666952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-890a43b6-076d-4599-a5d3-cf8b634e6ecc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:15.667384 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-890a43b6-076d-4599-a5d3-cf8b634e6ecc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:15.922416 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-890a43b6-076d-4599-a5d3-cf8b634e6ecc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:15.934640 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-890a43b6-076d-4599-a5d3-cf8b634e6ecc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.289792 Aug 13 04:30:15.939282 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 48/109] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:15 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:15.948305 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fbd3ddae-feae-4d64-90e5-7c411e81e0ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:15.954969 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fbd3ddae-feae-4d64-90e5-7c411e81e0ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:15.968385 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fbd3ddae-feae-4d64-90e5-7c411e81e0ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:15.970935 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fbd3ddae-feae-4d64-90e5-7c411e81e0ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:15.971799 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fbd3ddae-feae-4d64-90e5-7c411e81e0ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:15.973741 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fbd3ddae-feae-4d64-90e5-7c411e81e0ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:15.982915 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-19921a5b-9798-4849-80b7-f5df80b12a18 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:15.990688 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-19921a5b-9798-4849-80b7-f5df80b12a18 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.387724 Aug 13 04:30:16.000975 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 62/110] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:15 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:16.006985 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-87dcc52a-ec4d-482e-a7c8-0ed26e5b7c85 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:16.007602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-87dcc52a-ec4d-482e-a7c8-0ed26e5b7c85 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:16.016417 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87dcc52a-ec4d-482e-a7c8-0ed26e5b7c85 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:16.019238 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87dcc52a-ec4d-482e-a7c8-0ed26e5b7c85 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:16.020084 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87dcc52a-ec4d-482e-a7c8-0ed26e5b7c85 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:16.020520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87dcc52a-ec4d-482e-a7c8-0ed26e5b7c85 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:16.081299 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-fbd3ddae-feae-4d64-90e5-7c411e81e0ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:16.089242 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-fbd3ddae-feae-4d64-90e5-7c411e81e0ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:16.090969 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-fbd3ddae-feae-4d64-90e5-7c411e81e0ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:16.092498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fbd3ddae-feae-4d64-90e5-7c411e81e0ef tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.150708 Aug 13 04:30:16.093200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 49/111] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:15 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:16.206268 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-87dcc52a-ec4d-482e-a7c8-0ed26e5b7c85 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:16.241447 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-87dcc52a-ec4d-482e-a7c8-0ed26e5b7c85 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.247625 Aug 13 04:30:16.242048 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 63/112] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:15 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:16.956781 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-70fab94e-87c6-42ee-9876-42855f2c6839 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:16.957358 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-70fab94e-87c6-42ee-9876-42855f2c6839 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:16.968966 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-70fab94e-87c6-42ee-9876-42855f2c6839 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:16.969462 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-70fab94e-87c6-42ee-9876-42855f2c6839 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:16.970333 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-70fab94e-87c6-42ee-9876-42855f2c6839 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:16.970698 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-70fab94e-87c6-42ee-9876-42855f2c6839 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:17.009931 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c21246ff-b492-4773-88ef-96c96a8aee19 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:17.011156 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c21246ff-b492-4773-88ef-96c96a8aee19 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:17.019118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c21246ff-b492-4773-88ef-96c96a8aee19 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:17.022218 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c21246ff-b492-4773-88ef-96c96a8aee19 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:17.023051 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c21246ff-b492-4773-88ef-96c96a8aee19 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:17.023483 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c21246ff-b492-4773-88ef-96c96a8aee19 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:17.242894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-70fab94e-87c6-42ee-9876-42855f2c6839 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:17.255025 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-70fab94e-87c6-42ee-9876-42855f2c6839 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.299163 Aug 13 04:30:17.256172 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 50/113] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:16 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:17.269771 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-16ae7dde-925e-453a-931c-9d878b874e54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:17.271213 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-16ae7dde-925e-453a-931c-9d878b874e54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:17.280855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-16ae7dde-925e-453a-931c-9d878b874e54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:17.281607 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-16ae7dde-925e-453a-931c-9d878b874e54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:17.282932 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-16ae7dde-925e-453a-931c-9d878b874e54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:17.283511 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-16ae7dde-925e-453a-931c-9d878b874e54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:17.285379 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c21246ff-b492-4773-88ef-96c96a8aee19 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:17.296742 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c21246ff-b492-4773-88ef-96c96a8aee19 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.290472 Aug 13 04:30:17.298128 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 64/114] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:17 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:17.302543 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e1c0ce2e-dec7-4202-ba7d-5411d0e08c0e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:17.303157 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e1c0ce2e-dec7-4202-ba7d-5411d0e08c0e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:17.338245 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e1c0ce2e-dec7-4202-ba7d-5411d0e08c0e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:17.340529 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e1c0ce2e-dec7-4202-ba7d-5411d0e08c0e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:17.341618 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e1c0ce2e-dec7-4202-ba7d-5411d0e08c0e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:17.342226 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e1c0ce2e-dec7-4202-ba7d-5411d0e08c0e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:17.383894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-16ae7dde-925e-453a-931c-9d878b874e54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:17.392907 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-16ae7dde-925e-453a-931c-9d878b874e54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:17.394838 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-16ae7dde-925e-453a-931c-9d878b874e54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:17.397019 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-16ae7dde-925e-453a-931c-9d878b874e54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.139508 Aug 13 04:30:17.409686 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 51/115] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:17 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:17.576924 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e1c0ce2e-dec7-4202-ba7d-5411d0e08c0e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:17.585195 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e1c0ce2e-dec7-4202-ba7d-5411d0e08c0e tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.286014 Aug 13 04:30:17.590164 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 65/116] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:17 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:18.273902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1d867f79-2b93-45ec-983e-ae3ccd2f8a72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:18.275303 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1d867f79-2b93-45ec-983e-ae3ccd2f8a72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:18.282837 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d867f79-2b93-45ec-983e-ae3ccd2f8a72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:18.283323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d867f79-2b93-45ec-983e-ae3ccd2f8a72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:18.284108 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d867f79-2b93-45ec-983e-ae3ccd2f8a72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:18.284543 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d867f79-2b93-45ec-983e-ae3ccd2f8a72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:18.314851 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1446aa39-1ba1-470e-a8f3-7cad3aa8d401 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:18.315480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1446aa39-1ba1-470e-a8f3-7cad3aa8d401 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:18.328561 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1446aa39-1ba1-470e-a8f3-7cad3aa8d401 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:18.329346 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1446aa39-1ba1-470e-a8f3-7cad3aa8d401 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:18.334759 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1446aa39-1ba1-470e-a8f3-7cad3aa8d401 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:18.335586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1446aa39-1ba1-470e-a8f3-7cad3aa8d401 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:18.512713 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1d867f79-2b93-45ec-983e-ae3ccd2f8a72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:18.524625 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1d867f79-2b93-45ec-983e-ae3ccd2f8a72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.253229 Aug 13 04:30:18.526944 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 52/117] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:18 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:18.532602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5384c847-9e23-4103-b68f-61a9832fe24a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:18.534000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5384c847-9e23-4103-b68f-61a9832fe24a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:18.545603 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5384c847-9e23-4103-b68f-61a9832fe24a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:18.546890 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5384c847-9e23-4103-b68f-61a9832fe24a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:18.548105 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5384c847-9e23-4103-b68f-61a9832fe24a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:18.549638 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5384c847-9e23-4103-b68f-61a9832fe24a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:18.573105 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1446aa39-1ba1-470e-a8f3-7cad3aa8d401 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:18.581153 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1446aa39-1ba1-470e-a8f3-7cad3aa8d401 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.270880 Aug 13 04:30:18.592222 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 66/118] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:18 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:18.607496 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-78d341e7-1d55-4b40-88b6-ebd1520e26f0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:18.608108 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-78d341e7-1d55-4b40-88b6-ebd1520e26f0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:18.616157 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-78d341e7-1d55-4b40-88b6-ebd1520e26f0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:18.616859 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-78d341e7-1d55-4b40-88b6-ebd1520e26f0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:18.619142 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-78d341e7-1d55-4b40-88b6-ebd1520e26f0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:18.620021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-78d341e7-1d55-4b40-88b6-ebd1520e26f0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:18.648947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5384c847-9e23-4103-b68f-61a9832fe24a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:18.663023 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5384c847-9e23-4103-b68f-61a9832fe24a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:18.666693 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5384c847-9e23-4103-b68f-61a9832fe24a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:18.669951 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5384c847-9e23-4103-b68f-61a9832fe24a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.141487 Aug 13 04:30:18.677318 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 53/119] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:18 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:18.800771 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-78d341e7-1d55-4b40-88b6-ebd1520e26f0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:18.808943 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-78d341e7-1d55-4b40-88b6-ebd1520e26f0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.206460 Aug 13 04:30:18.809538 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 67/120] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:18 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:19.544336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7c0bbb9f-7a76-4fa2-b036-25acc7c84e17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:19.544968 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7c0bbb9f-7a76-4fa2-b036-25acc7c84e17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:19.550993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c0bbb9f-7a76-4fa2-b036-25acc7c84e17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:19.551423 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c0bbb9f-7a76-4fa2-b036-25acc7c84e17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:19.552205 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c0bbb9f-7a76-4fa2-b036-25acc7c84e17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:19.552608 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c0bbb9f-7a76-4fa2-b036-25acc7c84e17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:19.604118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5cd8fb1a-6d9b-44c6-adf6-c862132e3075 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:19.606524 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5cd8fb1a-6d9b-44c6-adf6-c862132e3075 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:19.612884 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5cd8fb1a-6d9b-44c6-adf6-c862132e3075 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:19.613346 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5cd8fb1a-6d9b-44c6-adf6-c862132e3075 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:19.614480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5cd8fb1a-6d9b-44c6-adf6-c862132e3075 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:19.614929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5cd8fb1a-6d9b-44c6-adf6-c862132e3075 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:19.718655 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7c0bbb9f-7a76-4fa2-b036-25acc7c84e17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:19.725928 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7c0bbb9f-7a76-4fa2-b036-25acc7c84e17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.186377 Aug 13 04:30:19.726493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 54/121] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:19 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:19.731429 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1efd9509-455a-4c39-b215-47701bf25181 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:19.732033 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1efd9509-455a-4c39-b215-47701bf25181 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:19.738193 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1efd9509-455a-4c39-b215-47701bf25181 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:19.738637 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1efd9509-455a-4c39-b215-47701bf25181 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:19.739444 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1efd9509-455a-4c39-b215-47701bf25181 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:19.739869 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1efd9509-455a-4c39-b215-47701bf25181 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:19.770324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5cd8fb1a-6d9b-44c6-adf6-c862132e3075 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:19.778973 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5cd8fb1a-6d9b-44c6-adf6-c862132e3075 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.182714 Aug 13 04:30:19.779640 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 68/122] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:19 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:19.801466 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1efd9509-455a-4c39-b215-47701bf25181 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:19.809590 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1efd9509-455a-4c39-b215-47701bf25181 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:19.811076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1efd9509-455a-4c39-b215-47701bf25181 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:19.812133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1efd9509-455a-4c39-b215-47701bf25181 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.084136 Aug 13 04:30:19.812671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 55/123] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:19 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:19.825825 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-cc73b2ff-de4e-42ae-876e-90ba965e81d1 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:19.826468 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-cc73b2ff-de4e-42ae-876e-90ba965e81d1 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:19.837498 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cc73b2ff-de4e-42ae-876e-90ba965e81d1 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:19.837942 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cc73b2ff-de4e-42ae-876e-90ba965e81d1 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:19.838710 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cc73b2ff-de4e-42ae-876e-90ba965e81d1 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:19.839144 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cc73b2ff-de4e-42ae-876e-90ba965e81d1 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:19.957330 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-cc73b2ff-de4e-42ae-876e-90ba965e81d1 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:19.965159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-cc73b2ff-de4e-42ae-876e-90ba965e81d1 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.142944 Aug 13 04:30:19.965755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 69/124] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:19 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:20.744526 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b78ea4e6-0681-4f06-8d03-52567650ed84 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:20.745381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b78ea4e6-0681-4f06-8d03-52567650ed84 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:20.754292 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b78ea4e6-0681-4f06-8d03-52567650ed84 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:20.754741 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b78ea4e6-0681-4f06-8d03-52567650ed84 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:20.755511 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b78ea4e6-0681-4f06-8d03-52567650ed84 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:20.755947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b78ea4e6-0681-4f06-8d03-52567650ed84 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:20.796252 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4c987c21-fe83-4d07-91f6-99a76090c694 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:20.797183 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4c987c21-fe83-4d07-91f6-99a76090c694 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:20.811931 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4c987c21-fe83-4d07-91f6-99a76090c694 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:20.812545 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4c987c21-fe83-4d07-91f6-99a76090c694 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:20.813262 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4c987c21-fe83-4d07-91f6-99a76090c694 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:20.814044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4c987c21-fe83-4d07-91f6-99a76090c694 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:20.952831 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b78ea4e6-0681-4f06-8d03-52567650ed84 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:20.963931 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b78ea4e6-0681-4f06-8d03-52567650ed84 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.224124 Aug 13 04:30:20.964633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 56/125] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:20 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:20.970185 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3db721af-9b03-46f1-a963-7dda87c2361f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:20.970988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3db721af-9b03-46f1-a963-7dda87c2361f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:20.980658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3db721af-9b03-46f1-a963-7dda87c2361f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:20.981090 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3db721af-9b03-46f1-a963-7dda87c2361f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:20.981892 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3db721af-9b03-46f1-a963-7dda87c2361f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:20.982327 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3db721af-9b03-46f1-a963-7dda87c2361f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:21.012162 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4c987c21-fe83-4d07-91f6-99a76090c694 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:21.024527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4c987c21-fe83-4d07-91f6-99a76090c694 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.231717 Aug 13 04:30:21.025108 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 70/126] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:20 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:21.029461 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-adb51d48-f6bf-4ef4-862e-d617d06aad30 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:21.030080 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-adb51d48-f6bf-4ef4-862e-d617d06aad30 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:21.036148 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-adb51d48-f6bf-4ef4-862e-d617d06aad30 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:21.036691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-adb51d48-f6bf-4ef4-862e-d617d06aad30 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:21.037371 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-adb51d48-f6bf-4ef4-862e-d617d06aad30 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:21.037838 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-adb51d48-f6bf-4ef4-862e-d617d06aad30 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:21.045586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3db721af-9b03-46f1-a963-7dda87c2361f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:21.054088 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3db721af-9b03-46f1-a963-7dda87c2361f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:21.056381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3db721af-9b03-46f1-a963-7dda87c2361f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:21.057495 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3db721af-9b03-46f1-a963-7dda87c2361f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1342 microversion: 2.20 time: 0.091670 Aug 13 04:30:21.058054 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 57/127] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:20 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1342 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:21.160861 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-adb51d48-f6bf-4ef4-862e-d617d06aad30 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:21.169367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-adb51d48-f6bf-4ef4-862e-d617d06aad30 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.143216 Aug 13 04:30:21.169972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 71/128] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:21 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:21.982363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b1540b65-6178-4915-b07d-1181ac360326 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:21.983610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b1540b65-6178-4915-b07d-1181ac360326 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:21.992036 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1540b65-6178-4915-b07d-1181ac360326 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:21.992484 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1540b65-6178-4915-b07d-1181ac360326 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:21.993323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1540b65-6178-4915-b07d-1181ac360326 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:21.993790 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1540b65-6178-4915-b07d-1181ac360326 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:22.043967 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-94883e8d-3d3a-4953-b9f9-943a41974830 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:22.044747 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-94883e8d-3d3a-4953-b9f9-943a41974830 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:22.052684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-94883e8d-3d3a-4953-b9f9-943a41974830 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:22.053409 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-94883e8d-3d3a-4953-b9f9-943a41974830 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:22.055039 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-94883e8d-3d3a-4953-b9f9-943a41974830 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:22.055913 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-94883e8d-3d3a-4953-b9f9-943a41974830 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:22.562799 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b1540b65-6178-4915-b07d-1181ac360326 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:22.578051 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b1540b65-6178-4915-b07d-1181ac360326 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.600684 Aug 13 04:30:22.589943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 58/129] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:21 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:22.594764 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-dd4e8e7e-cdb8-4214-9019-49dbb825e00e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:22.595714 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-dd4e8e7e-cdb8-4214-9019-49dbb825e00e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:22.603676 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dd4e8e7e-cdb8-4214-9019-49dbb825e00e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:22.604439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dd4e8e7e-cdb8-4214-9019-49dbb825e00e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:22.612229 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-94883e8d-3d3a-4953-b9f9-943a41974830 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:22.621231 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-94883e8d-3d3a-4953-b9f9-943a41974830 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.582894 Aug 13 04:30:22.621893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dd4e8e7e-cdb8-4214-9019-49dbb825e00e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:22.622521 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dd4e8e7e-cdb8-4214-9019-49dbb825e00e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:22.626501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 72/130] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:22 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:22.633912 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-50addc44-5550-4956-928a-3b927dc71441 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:22.634829 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-50addc44-5550-4956-928a-3b927dc71441 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:22.656283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-50addc44-5550-4956-928a-3b927dc71441 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:22.660396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-50addc44-5550-4956-928a-3b927dc71441 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:22.661462 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-50addc44-5550-4956-928a-3b927dc71441 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:22.662110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-50addc44-5550-4956-928a-3b927dc71441 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:23.150652 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-dd4e8e7e-cdb8-4214-9019-49dbb825e00e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:23.164034 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-dd4e8e7e-cdb8-4214-9019-49dbb825e00e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:23.192789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-dd4e8e7e-cdb8-4214-9019-49dbb825e00e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:23.196503 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-dd4e8e7e-cdb8-4214-9019-49dbb825e00e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.603751 Aug 13 04:30:23.199373 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 59/131] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:22 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:23.403319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-50addc44-5550-4956-928a-3b927dc71441 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:23.411763 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-50addc44-5550-4956-928a-3b927dc71441 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.783998 Aug 13 04:30:23.412666 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 73/132] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:22 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:23.596227 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-19719aa0-ab0a-4af1-9a21-75b3df593e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:23.596843 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-19719aa0-ab0a-4af1-9a21-75b3df593e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:23.610755 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-19719aa0-ab0a-4af1-9a21-75b3df593e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:23.611401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-19719aa0-ab0a-4af1-9a21-75b3df593e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:23.612247 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-19719aa0-ab0a-4af1-9a21-75b3df593e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:23.612676 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-19719aa0-ab0a-4af1-9a21-75b3df593e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:23.652192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-03922947-ed86-460c-90e4-43d99836a3f4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:23.652828 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-03922947-ed86-460c-90e4-43d99836a3f4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:23.667971 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03922947-ed86-460c-90e4-43d99836a3f4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:23.671299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03922947-ed86-460c-90e4-43d99836a3f4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:23.675323 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03922947-ed86-460c-90e4-43d99836a3f4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:23.677112 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03922947-ed86-460c-90e4-43d99836a3f4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.067715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-03922947-ed86-460c-90e4-43d99836a3f4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:24.083296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-03922947-ed86-460c-90e4-43d99836a3f4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.435549 Aug 13 04:30:24.094523 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 74/133] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:23 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:24.107523 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-19719aa0-ab0a-4af1-9a21-75b3df593e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:24.117675 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-19719aa0-ab0a-4af1-9a21-75b3df593e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.524829 Aug 13 04:30:24.119311 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 60/134] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:23 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:24.191276 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-d23f22f8-e351-46f5-a402-bc2325cc0b7a req-76d627ea-f86b-46e9-9603-646cd8357cf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0662f42-e77d-4f85-84ad-b58befdc445d", "tag": "f5bada29-7024-47b0-b3dd-d142dd41cdda"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:24.198659 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:30:24.198659 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:30:24.217050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-d23f22f8-e351-46f5-a402-bc2325cc0b7a req-76d627ea-f86b-46e9-9603-646cd8357cf4 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:24.217832 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-d23f22f8-e351-46f5-a402-bc2325cc0b7a req-76d627ea-f86b-46e9-9603-646cd8357cf4 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.227884 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-0d3b3c3a-f164-47d6-894c-4adeee562cad req-fb8a7ca4-f34f-4014-9e3b-bc79d4c7a143 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4efb80e9-e2d4-416d-ad9d-3957beb33d56", "tag": "4a62d4b3-3837-414b-a01d-079fec907da0"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:24.230825 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:30:24.230825 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:30:24.252073 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-0d3b3c3a-f164-47d6-894c-4adeee562cad req-fb8a7ca4-f34f-4014-9e3b-bc79d4c7a143 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:24.252510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-0d3b3c3a-f164-47d6-894c-4adeee562cad req-fb8a7ca4-f34f-4014-9e3b-bc79d4c7a143 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.269987 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-d23f22f8-e351-46f5-a402-bc2325cc0b7a req-76d627ea-f86b-46e9-9603-646cd8357cf4 service nova] Creating event network-changed:f5bada29-7024-47b0-b3dd-d142dd41cdda for instance a0662f42-e77d-4f85-84ad-b58befdc445d on hv-cinder-75996 Aug 13 04:30:24.270512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-d23f22f8-e351-46f5-a402-bc2325cc0b7a req-76d627ea-f86b-46e9-9603-646cd8357cf4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108287) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 13 04:30:24.271721 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7fe1b4ea-146d-4901-94f6-8cf76081d186 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:24.272159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7fe1b4ea-146d-4901-94f6-8cf76081d186 None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.273128 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7fe1b4ea-146d-4901-94f6-8cf76081d186 None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:24.274085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7fe1b4ea-146d-4901-94f6-8cf76081d186 None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.294512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.compute.rpcapi [None req-7fe1b4ea-146d-4901-94f6-8cf76081d186 None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 13 04:30:24.295664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7fe1b4ea-146d-4901-94f6-8cf76081d186 None None] Releasing lock "compute-rpcapi-router" {{(pid=108287) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 13 04:30:24.297694 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-0d3b3c3a-f164-47d6-894c-4adeee562cad req-fb8a7ca4-f34f-4014-9e3b-bc79d4c7a143 service nova] Creating event network-changed:4a62d4b3-3837-414b-a01d-079fec907da0 for instance 4efb80e9-e2d4-416d-ad9d-3957beb33d56 on hv-cinder-75996 Aug 13 04:30:24.298205 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-0d3b3c3a-f164-47d6-894c-4adeee562cad req-fb8a7ca4-f34f-4014-9e3b-bc79d4c7a143 service nova] Acquired lock "compute-rpcapi-router" {{(pid=108288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:266}} Aug 13 04:30:24.299311 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-12105046-7504-4f71-861b-76f44ff3959f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:24.299747 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-12105046-7504-4f71-861b-76f44ff3959f None None] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.300521 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-12105046-7504-4f71-861b-76f44ff3959f None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:24.300946 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-12105046-7504-4f71-861b-76f44ff3959f None None] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.319500 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.compute.rpcapi [None req-12105046-7504-4f71-861b-76f44ff3959f None None] Automatically selected compute RPC version 6.0 from minimum service version 56 Aug 13 04:30:24.322148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-12105046-7504-4f71-861b-76f44ff3959f None None] Releasing lock "compute-rpcapi-router" {{(pid=108288) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:282}} Aug 13 04:30:24.347085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7fe1b4ea-146d-4901-94f6-8cf76081d186 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.250427 Aug 13 04:30:24.348142 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 75/135] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:30:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:30:24.354280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4cb8c1ca-c3fd-4427-8c9e-1b7d65f6b30d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:24.356363 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4cb8c1ca-c3fd-4427-8c9e-1b7d65f6b30d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:24.372023 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-12105046-7504-4f71-861b-76f44ff3959f None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.251194 Aug 13 04:30:24.372877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 61/136] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:30:24 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:30:24.382218 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4cb8c1ca-c3fd-4427-8c9e-1b7d65f6b30d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:24.385998 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4cb8c1ca-c3fd-4427-8c9e-1b7d65f6b30d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.386868 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4cb8c1ca-c3fd-4427-8c9e-1b7d65f6b30d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:24.387429 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4cb8c1ca-c3fd-4427-8c9e-1b7d65f6b30d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.438850 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ee569ee3-b74e-4b5d-86fa-fd3bfab259e0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:24.440228 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ee569ee3-b74e-4b5d-86fa-fd3bfab259e0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:24.455522 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee569ee3-b74e-4b5d-86fa-fd3bfab259e0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:24.456489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee569ee3-b74e-4b5d-86fa-fd3bfab259e0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.457610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee569ee3-b74e-4b5d-86fa-fd3bfab259e0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:24.458354 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee569ee3-b74e-4b5d-86fa-fd3bfab259e0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:24.709485 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4cb8c1ca-c3fd-4427-8c9e-1b7d65f6b30d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:24.718439 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4cb8c1ca-c3fd-4427-8c9e-1b7d65f6b30d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:24.720225 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4cb8c1ca-c3fd-4427-8c9e-1b7d65f6b30d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:24.721321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4cb8c1ca-c3fd-4427-8c9e-1b7d65f6b30d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.371686 Aug 13 04:30:24.721963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 76/137] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:24 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:24.749412 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ee569ee3-b74e-4b5d-86fa-fd3bfab259e0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:24.760976 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ee569ee3-b74e-4b5d-86fa-fd3bfab259e0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.335554 Aug 13 04:30:24.762060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 62/138] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:24 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:25.105394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3f3fc32d-9ca7-4420-957e-00a4f8a9105c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:25.106120 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3f3fc32d-9ca7-4420-957e-00a4f8a9105c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:25.112682 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f3fc32d-9ca7-4420-957e-00a4f8a9105c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:25.113129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f3fc32d-9ca7-4420-957e-00a4f8a9105c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:25.114033 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f3fc32d-9ca7-4420-957e-00a4f8a9105c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:25.114541 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f3fc32d-9ca7-4420-957e-00a4f8a9105c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:25.137881 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2d968874-d2fc-444e-89a5-3226884cbcfc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:25.138751 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2d968874-d2fc-444e-89a5-3226884cbcfc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:25.144918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d968874-d2fc-444e-89a5-3226884cbcfc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:25.145633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d968874-d2fc-444e-89a5-3226884cbcfc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:25.146451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d968874-d2fc-444e-89a5-3226884cbcfc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:25.147041 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d968874-d2fc-444e-89a5-3226884cbcfc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:25.510553 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3f3fc32d-9ca7-4420-957e-00a4f8a9105c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:25.517217 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2d968874-d2fc-444e-89a5-3226884cbcfc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:25.521481 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3f3fc32d-9ca7-4420-957e-00a4f8a9105c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.419436 Aug 13 04:30:25.522748 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 77/139] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:25 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:25.534049 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2d968874-d2fc-444e-89a5-3226884cbcfc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.401207 Aug 13 04:30:25.534650 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 63/140] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:25 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:25.743320 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7aa5bc19-e02d-49fe-8f29-f73fc691b673 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:25.744305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7aa5bc19-e02d-49fe-8f29-f73fc691b673 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:25.751389 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7aa5bc19-e02d-49fe-8f29-f73fc691b673 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:25.751834 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7aa5bc19-e02d-49fe-8f29-f73fc691b673 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:25.752592 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7aa5bc19-e02d-49fe-8f29-f73fc691b673 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:25.753017 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7aa5bc19-e02d-49fe-8f29-f73fc691b673 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:25.786656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ada8982d-82d7-4663-bb0a-53a887aa291c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:25.787777 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ada8982d-82d7-4663-bb0a-53a887aa291c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:25.794422 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ada8982d-82d7-4663-bb0a-53a887aa291c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:25.794994 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ada8982d-82d7-4663-bb0a-53a887aa291c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:25.796244 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ada8982d-82d7-4663-bb0a-53a887aa291c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:25.796924 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ada8982d-82d7-4663-bb0a-53a887aa291c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:25.948247 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7aa5bc19-e02d-49fe-8f29-f73fc691b673 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:25.956403 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7aa5bc19-e02d-49fe-8f29-f73fc691b673 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:25.957941 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7aa5bc19-e02d-49fe-8f29-f73fc691b673 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:25.959037 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7aa5bc19-e02d-49fe-8f29-f73fc691b673 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.222515 Aug 13 04:30:25.959715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 78/141] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:25 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:25.969235 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ada8982d-82d7-4663-bb0a-53a887aa291c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:25.978350 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ada8982d-82d7-4663-bb0a-53a887aa291c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.198291 Aug 13 04:30:25.979138 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 64/142] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:25 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:26.376355 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-b5781bcc-e35c-4749-bf57-cbd3bb39164d req-b99e86ea-2526-41ef-abaa-cc3a5d2df087 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d299e5c1-cd60-4057-93a3-5d32e1908d2f", "tag": "c3be48be-e5ee-48ea-a418-bc6c5c7a337c"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:26.378110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:30:26.378110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:30:26.387197 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-b5781bcc-e35c-4749-bf57-cbd3bb39164d req-b99e86ea-2526-41ef-abaa-cc3a5d2df087 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:26.387625 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-b5781bcc-e35c-4749-bf57-cbd3bb39164d req-b99e86ea-2526-41ef-abaa-cc3a5d2df087 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:26.389691 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-3ee4888d-2da1-46e6-85b4-e988311a30fd req-73dd6598-49c9-4a18-a1c7-59f5d6137c7b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "47f20e62-089b-4313-bad1-6139880e21cd", "tag": "7ac239ef-8a51-4298-8f3f-3e873f6190de"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:26.391438 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:30:26.391438 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:30:26.399800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-b5781bcc-e35c-4749-bf57-cbd3bb39164d req-b99e86ea-2526-41ef-abaa-cc3a5d2df087 service nova] Creating event network-changed:c3be48be-e5ee-48ea-a418-bc6c5c7a337c for instance d299e5c1-cd60-4057-93a3-5d32e1908d2f on hv-cinder-75996 Aug 13 04:30:26.400085 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-3ee4888d-2da1-46e6-85b4-e988311a30fd req-73dd6598-49c9-4a18-a1c7-59f5d6137c7b service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:26.400626 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-3ee4888d-2da1-46e6-85b4-e988311a30fd req-73dd6598-49c9-4a18-a1c7-59f5d6137c7b service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:26.408861 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-b5781bcc-e35c-4749-bf57-cbd3bb39164d req-b99e86ea-2526-41ef-abaa-cc3a5d2df087 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035774 Aug 13 04:30:26.409761 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 79/143] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:30:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:30:26.413392 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-3ee4888d-2da1-46e6-85b4-e988311a30fd req-73dd6598-49c9-4a18-a1c7-59f5d6137c7b service nova] Creating event network-changed:7ac239ef-8a51-4298-8f3f-3e873f6190de for instance 47f20e62-089b-4313-bad1-6139880e21cd on hv-cinder-75996 Aug 13 04:30:26.418776 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-3ee4888d-2da1-46e6-85b4-e988311a30fd req-73dd6598-49c9-4a18-a1c7-59f5d6137c7b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033451 Aug 13 04:30:26.419372 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 65/144] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:30:26 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:30:26.542552 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-33874973-8c3c-44aa-9067-92f79bf8bb3b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:26.543524 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-33874973-8c3c-44aa-9067-92f79bf8bb3b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:26.551635 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-696abd96-b9ad-4ff7-bab2-08c7acf73fc6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:26.552322 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-696abd96-b9ad-4ff7-bab2-08c7acf73fc6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:26.553379 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33874973-8c3c-44aa-9067-92f79bf8bb3b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:26.554042 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33874973-8c3c-44aa-9067-92f79bf8bb3b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:26.555568 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33874973-8c3c-44aa-9067-92f79bf8bb3b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:26.556197 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33874973-8c3c-44aa-9067-92f79bf8bb3b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:26.560777 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-696abd96-b9ad-4ff7-bab2-08c7acf73fc6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:26.561231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-696abd96-b9ad-4ff7-bab2-08c7acf73fc6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:26.562034 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-696abd96-b9ad-4ff7-bab2-08c7acf73fc6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:26.562476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-696abd96-b9ad-4ff7-bab2-08c7acf73fc6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:27.098026 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-696abd96-b9ad-4ff7-bab2-08c7acf73fc6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:27.105779 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-696abd96-b9ad-4ff7-bab2-08c7acf73fc6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.558015 Aug 13 04:30:27.106867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 66/145] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:26 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:27.119922 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e6496470-2707-4636-af17-efa05fb737b3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:27.120813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e6496470-2707-4636-af17-efa05fb737b3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:27.128302 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e6496470-2707-4636-af17-efa05fb737b3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:27.128965 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e6496470-2707-4636-af17-efa05fb737b3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:27.130077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-33874973-8c3c-44aa-9067-92f79bf8bb3b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:27.130585 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e6496470-2707-4636-af17-efa05fb737b3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:27.131154 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e6496470-2707-4636-af17-efa05fb737b3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:27.138863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-33874973-8c3c-44aa-9067-92f79bf8bb3b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.603208 Aug 13 04:30:27.140374 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 80/146] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:26 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:27.149510 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-983d5719-03ae-4527-8cca-18673225142c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:27.150809 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-983d5719-03ae-4527-8cca-18673225142c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:27.158513 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-983d5719-03ae-4527-8cca-18673225142c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:27.159502 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-983d5719-03ae-4527-8cca-18673225142c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:27.160700 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-983d5719-03ae-4527-8cca-18673225142c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:27.161331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-983d5719-03ae-4527-8cca-18673225142c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:27.665971 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e6496470-2707-4636-af17-efa05fb737b3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:27.675392 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e6496470-2707-4636-af17-efa05fb737b3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:27.676773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e6496470-2707-4636-af17-efa05fb737b3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:27.677914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e6496470-2707-4636-af17-efa05fb737b3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.569907 Aug 13 04:30:27.686467 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 67/147] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:27 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:27.709494 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-983d5719-03ae-4527-8cca-18673225142c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:27.717069 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-983d5719-03ae-4527-8cca-18673225142c tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.573432 Aug 13 04:30:27.717889 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 81/148] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:27 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:28.123157 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d0a74f8d-5aee-4167-aa12-aff9c52533ef tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:28.123853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d0a74f8d-5aee-4167-aa12-aff9c52533ef tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:28.130253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d0a74f8d-5aee-4167-aa12-aff9c52533ef tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:28.130768 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d0a74f8d-5aee-4167-aa12-aff9c52533ef tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:28.131711 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d0a74f8d-5aee-4167-aa12-aff9c52533ef tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:28.132329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d0a74f8d-5aee-4167-aa12-aff9c52533ef tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:28.156890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-291a989e-8952-45a7-aeb1-218056408c0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:28.158545 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-291a989e-8952-45a7-aeb1-218056408c0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:28.165391 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-291a989e-8952-45a7-aeb1-218056408c0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:28.166192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-291a989e-8952-45a7-aeb1-218056408c0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:28.167818 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-291a989e-8952-45a7-aeb1-218056408c0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:28.168412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-291a989e-8952-45a7-aeb1-218056408c0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:28.333252 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d0a74f8d-5aee-4167-aa12-aff9c52533ef tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:28.341313 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d0a74f8d-5aee-4167-aa12-aff9c52533ef tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.221764 Aug 13 04:30:28.341928 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 68/149] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:28 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:28.351508 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-291a989e-8952-45a7-aeb1-218056408c0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:28.359998 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-291a989e-8952-45a7-aeb1-218056408c0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.207164 Aug 13 04:30:28.360296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 82/150] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:28 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:28.704067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5534507c-13f0-4339-99ee-88b8e41a6c52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:28.704671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5534507c-13f0-4339-99ee-88b8e41a6c52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:28.710758 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5534507c-13f0-4339-99ee-88b8e41a6c52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:28.711205 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5534507c-13f0-4339-99ee-88b8e41a6c52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:28.711967 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5534507c-13f0-4339-99ee-88b8e41a6c52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:28.712395 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5534507c-13f0-4339-99ee-88b8e41a6c52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:28.732912 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ace39d3f-aede-4e62-a556-60605bb15fe8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:28.733540 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ace39d3f-aede-4e62-a556-60605bb15fe8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:28.739259 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ace39d3f-aede-4e62-a556-60605bb15fe8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:28.739699 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ace39d3f-aede-4e62-a556-60605bb15fe8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:28.740452 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ace39d3f-aede-4e62-a556-60605bb15fe8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:28.740878 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ace39d3f-aede-4e62-a556-60605bb15fe8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:28.893125 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5534507c-13f0-4339-99ee-88b8e41a6c52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:28.900287 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ace39d3f-aede-4e62-a556-60605bb15fe8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:28.901674 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5534507c-13f0-4339-99ee-88b8e41a6c52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:28.903174 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5534507c-13f0-4339-99ee-88b8e41a6c52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:28.904256 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5534507c-13f0-4339-99ee-88b8e41a6c52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.204067 Aug 13 04:30:28.904808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 69/151] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:28 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:28.907987 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ace39d3f-aede-4e62-a556-60605bb15fe8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.178623 Aug 13 04:30:28.908661 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 83/152] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:28 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:29.358461 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0308ddfd-02cb-4430-91b3-92bc585b9340 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:29.359072 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0308ddfd-02cb-4430-91b3-92bc585b9340 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:29.365319 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0308ddfd-02cb-4430-91b3-92bc585b9340 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:29.365799 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0308ddfd-02cb-4430-91b3-92bc585b9340 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:29.366566 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0308ddfd-02cb-4430-91b3-92bc585b9340 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:29.367001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0308ddfd-02cb-4430-91b3-92bc585b9340 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:29.378277 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-24784f96-a9f7-48c5-ab90-aa486f7bdf7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:29.378890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-24784f96-a9f7-48c5-ab90-aa486f7bdf7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:29.384903 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-24784f96-a9f7-48c5-ab90-aa486f7bdf7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:29.385358 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-24784f96-a9f7-48c5-ab90-aa486f7bdf7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:29.386158 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-24784f96-a9f7-48c5-ab90-aa486f7bdf7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:29.386593 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-24784f96-a9f7-48c5-ab90-aa486f7bdf7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:29.707751 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-0308ddfd-02cb-4430-91b3-92bc585b9340 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:29.712961 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-24784f96-a9f7-48c5-ab90-aa486f7bdf7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:29.715726 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0308ddfd-02cb-4430-91b3-92bc585b9340 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.360835 Aug 13 04:30:29.716306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 70/153] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:29 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:29.720426 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-24784f96-a9f7-48c5-ab90-aa486f7bdf7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.345814 Aug 13 04:30:29.721020 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 84/154] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:29 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:29.921312 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-73aac7b1-113f-4f70-8aca-e5ab96126e0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:29.921894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-73aac7b1-113f-4f70-8aca-e5ab96126e0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:29.924405 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6fc9b290-0a62-4f4e-8728-64df6be8a818 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:29.925023 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6fc9b290-0a62-4f4e-8728-64df6be8a818 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:29.927898 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-73aac7b1-113f-4f70-8aca-e5ab96126e0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:29.928354 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-73aac7b1-113f-4f70-8aca-e5ab96126e0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:29.929126 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-73aac7b1-113f-4f70-8aca-e5ab96126e0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:29.929588 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-73aac7b1-113f-4f70-8aca-e5ab96126e0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:29.931253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6fc9b290-0a62-4f4e-8728-64df6be8a818 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:29.931709 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6fc9b290-0a62-4f4e-8728-64df6be8a818 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:29.932552 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6fc9b290-0a62-4f4e-8728-64df6be8a818 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:29.932989 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6fc9b290-0a62-4f4e-8728-64df6be8a818 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:30.114236 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6fc9b290-0a62-4f4e-8728-64df6be8a818 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:30.116616 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-73aac7b1-113f-4f70-8aca-e5ab96126e0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:30.121984 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6fc9b290-0a62-4f4e-8728-64df6be8a818 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.201089 Aug 13 04:30:30.122720 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 85/155] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:29 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:30.126204 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-73aac7b1-113f-4f70-8aca-e5ab96126e0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:30.127836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-73aac7b1-113f-4f70-8aca-e5ab96126e0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:30.128918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-73aac7b1-113f-4f70-8aca-e5ab96126e0b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.211590 Aug 13 04:30:30.129622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 71/156] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:29 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:30.749031 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2e8cef65-6800-4ebd-b53d-6ab417331749 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:30.750203 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2e8cef65-6800-4ebd-b53d-6ab417331749 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:30.754634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ab6b46c5-253b-44a9-92bb-4558c3374268 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:30.756937 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ab6b46c5-253b-44a9-92bb-4558c3374268 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:30.767582 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e8cef65-6800-4ebd-b53d-6ab417331749 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:30.768375 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e8cef65-6800-4ebd-b53d-6ab417331749 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:30.774938 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ab6b46c5-253b-44a9-92bb-4558c3374268 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:30.775739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ab6b46c5-253b-44a9-92bb-4558c3374268 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:30.777460 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ab6b46c5-253b-44a9-92bb-4558c3374268 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:30.778192 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ab6b46c5-253b-44a9-92bb-4558c3374268 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:30.785900 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e8cef65-6800-4ebd-b53d-6ab417331749 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:30.786709 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e8cef65-6800-4ebd-b53d-6ab417331749 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:31.208930 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ab6b46c5-253b-44a9-92bb-4558c3374268 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:31.231972 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ab6b46c5-253b-44a9-92bb-4558c3374268 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.497179 Aug 13 04:30:31.244929 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 72/157] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:30 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 511 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:31.250865 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0d96abcf-fb7e-4294-8da6-3fc26a458491 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:31.251716 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0d96abcf-fb7e-4294-8da6-3fc26a458491 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:31.259133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0d96abcf-fb7e-4294-8da6-3fc26a458491 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:31.259729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0d96abcf-fb7e-4294-8da6-3fc26a458491 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:31.260834 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0d96abcf-fb7e-4294-8da6-3fc26a458491 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:31.261726 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0d96abcf-fb7e-4294-8da6-3fc26a458491 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:31.322695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2e8cef65-6800-4ebd-b53d-6ab417331749 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:31.346406 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2e8cef65-6800-4ebd-b53d-6ab417331749 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.616192 Aug 13 04:30:31.347151 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 86/158] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:30 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:31.359857 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-bc898108-8b04-4c9c-bee1-f607cbea5c12 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:31.361188 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-bc898108-8b04-4c9c-bee1-f607cbea5c12 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:31.368505 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bc898108-8b04-4c9c-bee1-f607cbea5c12 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:31.371132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bc898108-8b04-4c9c-bee1-f607cbea5c12 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:31.374151 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bc898108-8b04-4c9c-bee1-f607cbea5c12 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:31.375099 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bc898108-8b04-4c9c-bee1-f607cbea5c12 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:31.626887 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-0d96abcf-fb7e-4294-8da6-3fc26a458491 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:31.645318 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0d96abcf-fb7e-4294-8da6-3fc26a458491 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.398844 Aug 13 04:30:31.651029 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 73/159] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:31 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:31.675199 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-bc898108-8b04-4c9c-bee1-f607cbea5c12 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:31.686328 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-bc898108-8b04-4c9c-bee1-f607cbea5c12 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:31.688040 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-bc898108-8b04-4c9c-bee1-f607cbea5c12 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:31.689175 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-bc898108-8b04-4c9c-bee1-f607cbea5c12 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.340946 Aug 13 04:30:31.689748 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 87/160] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:31 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:32.249782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c325bcd8-b0b7-4b96-ba4b-a0e12af80e5a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:32.250321 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c325bcd8-b0b7-4b96-ba4b-a0e12af80e5a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:32.258870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c325bcd8-b0b7-4b96-ba4b-a0e12af80e5a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:32.259411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c325bcd8-b0b7-4b96-ba4b-a0e12af80e5a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:32.260321 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c325bcd8-b0b7-4b96-ba4b-a0e12af80e5a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:32.260749 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c325bcd8-b0b7-4b96-ba4b-a0e12af80e5a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:32.363712 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9a11feec-1668-467d-9af8-16f1b4012914 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:32.364883 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9a11feec-1668-467d-9af8-16f1b4012914 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:32.371528 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a11feec-1668-467d-9af8-16f1b4012914 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:32.372823 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a11feec-1668-467d-9af8-16f1b4012914 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:32.374366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a11feec-1668-467d-9af8-16f1b4012914 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:32.377976 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a11feec-1668-467d-9af8-16f1b4012914 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:32.414807 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c325bcd8-b0b7-4b96-ba4b-a0e12af80e5a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:32.422298 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c325bcd8-b0b7-4b96-ba4b-a0e12af80e5a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.176412 Aug 13 04:30:32.422860 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 74/161] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:32 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:32.547216 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9a11feec-1668-467d-9af8-16f1b4012914 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:32.554755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9a11feec-1668-467d-9af8-16f1b4012914 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.194603 Aug 13 04:30:32.564444 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 88/162] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:32 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:32.671978 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9c5d04d7-b0d4-45bd-a1ed-01d9c2ee5999 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:32.672864 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9c5d04d7-b0d4-45bd-a1ed-01d9c2ee5999 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:32.680956 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c5d04d7-b0d4-45bd-a1ed-01d9c2ee5999 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:32.682155 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c5d04d7-b0d4-45bd-a1ed-01d9c2ee5999 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:32.683196 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c5d04d7-b0d4-45bd-a1ed-01d9c2ee5999 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:32.683817 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c5d04d7-b0d4-45bd-a1ed-01d9c2ee5999 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:32.711770 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0b57896c-0978-43db-90fd-ead162d04b5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:32.712543 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0b57896c-0978-43db-90fd-ead162d04b5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:32.720935 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b57896c-0978-43db-90fd-ead162d04b5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:32.721614 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b57896c-0978-43db-90fd-ead162d04b5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:32.722862 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b57896c-0978-43db-90fd-ead162d04b5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:32.723450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b57896c-0978-43db-90fd-ead162d04b5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:32.986302 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9c5d04d7-b0d4-45bd-a1ed-01d9c2ee5999 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:33.003337 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0b57896c-0978-43db-90fd-ead162d04b5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:33.006864 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9c5d04d7-b0d4-45bd-a1ed-01d9c2ee5999 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.342570 Aug 13 04:30:33.007451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 75/163] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:32 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:33.016768 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0b57896c-0978-43db-90fd-ead162d04b5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:33.019186 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0b57896c-0978-43db-90fd-ead162d04b5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:33.034277 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0b57896c-0978-43db-90fd-ead162d04b5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.329472 Aug 13 04:30:33.035082 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 89/164] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:32 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:33.440029 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a7568a95-32c9-4408-b21f-8be8534992ee tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:33.440643 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a7568a95-32c9-4408-b21f-8be8534992ee tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:33.447514 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7568a95-32c9-4408-b21f-8be8534992ee tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:33.447964 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7568a95-32c9-4408-b21f-8be8534992ee tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:33.448734 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7568a95-32c9-4408-b21f-8be8534992ee tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:33.449164 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7568a95-32c9-4408-b21f-8be8534992ee tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:33.573949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a7568a95-32c9-4408-b21f-8be8534992ee tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:33.576072 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-df50968e-092b-4ed4-a0b7-31606dae9221 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:33.576572 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-df50968e-092b-4ed4-a0b7-31606dae9221 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:33.581924 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a7568a95-32c9-4408-b21f-8be8534992ee tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.145713 Aug 13 04:30:33.582563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 76/165] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:33 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:33.583000 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-df50968e-092b-4ed4-a0b7-31606dae9221 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:33.583528 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-df50968e-092b-4ed4-a0b7-31606dae9221 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:33.584303 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-df50968e-092b-4ed4-a0b7-31606dae9221 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:33.584735 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-df50968e-092b-4ed4-a0b7-31606dae9221 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:33.716922 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-df50968e-092b-4ed4-a0b7-31606dae9221 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:33.724221 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-df50968e-092b-4ed4-a0b7-31606dae9221 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.156130 Aug 13 04:30:33.724779 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 90/166] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:33 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:34.024480 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-95a00a63-52d9-4d7f-b64d-1a270b498f1b tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:34.025551 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-95a00a63-52d9-4d7f-b64d-1a270b498f1b tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:34.032208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-95a00a63-52d9-4d7f-b64d-1a270b498f1b tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:34.032870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-95a00a63-52d9-4d7f-b64d-1a270b498f1b tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:34.034156 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-95a00a63-52d9-4d7f-b64d-1a270b498f1b tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:34.034673 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-95a00a63-52d9-4d7f-b64d-1a270b498f1b tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:34.051864 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-99c63c5a-37ad-4fdf-9f3b-9c708d1d65ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:34.052636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-99c63c5a-37ad-4fdf-9f3b-9c708d1d65ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:34.061861 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-99c63c5a-37ad-4fdf-9f3b-9c708d1d65ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:34.063983 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-99c63c5a-37ad-4fdf-9f3b-9c708d1d65ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:34.067533 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-99c63c5a-37ad-4fdf-9f3b-9c708d1d65ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:34.067911 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-99c63c5a-37ad-4fdf-9f3b-9c708d1d65ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:34.201189 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-95a00a63-52d9-4d7f-b64d-1a270b498f1b tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:34.218988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-95a00a63-52d9-4d7f-b64d-1a270b498f1b tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.198106 Aug 13 04:30:34.220052 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 77/167] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:34 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:34.310102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-99c63c5a-37ad-4fdf-9f3b-9c708d1d65ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:34.323251 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-99c63c5a-37ad-4fdf-9f3b-9c708d1d65ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:34.325165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-99c63c5a-37ad-4fdf-9f3b-9c708d1d65ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:34.326836 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-99c63c5a-37ad-4fdf-9f3b-9c708d1d65ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.278523 Aug 13 04:30:34.334602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 91/168] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:34 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:34.608778 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-300bb7af-c642-4579-b8f7-eca1dc41062d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:34.609360 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-300bb7af-c642-4579-b8f7-eca1dc41062d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:34.620233 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-300bb7af-c642-4579-b8f7-eca1dc41062d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:34.621092 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-300bb7af-c642-4579-b8f7-eca1dc41062d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:34.622216 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-300bb7af-c642-4579-b8f7-eca1dc41062d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:34.622803 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-300bb7af-c642-4579-b8f7-eca1dc41062d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:34.741244 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-dc17b769-38b0-4932-8b3a-45f9789e0061 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:34.741934 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-dc17b769-38b0-4932-8b3a-45f9789e0061 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:34.754956 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc17b769-38b0-4932-8b3a-45f9789e0061 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:34.755429 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc17b769-38b0-4932-8b3a-45f9789e0061 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:34.756662 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc17b769-38b0-4932-8b3a-45f9789e0061 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:34.757143 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc17b769-38b0-4932-8b3a-45f9789e0061 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:34.793132 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-300bb7af-c642-4579-b8f7-eca1dc41062d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:34.800923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-300bb7af-c642-4579-b8f7-eca1dc41062d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.204489 Aug 13 04:30:34.801510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 78/169] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:34 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:34.906910 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dc17b769-38b0-4932-8b3a-45f9789e0061 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:34.915015 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dc17b769-38b0-4932-8b3a-45f9789e0061 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.177345 Aug 13 04:30:34.915579 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 92/170] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:34 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:35.239443 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bef140ed-af6d-4675-8878-3334f566962a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:35.240412 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bef140ed-af6d-4675-8878-3334f566962a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:35.251076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bef140ed-af6d-4675-8878-3334f566962a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:35.251709 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bef140ed-af6d-4675-8878-3334f566962a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:35.252848 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bef140ed-af6d-4675-8878-3334f566962a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:35.253782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bef140ed-af6d-4675-8878-3334f566962a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:35.346559 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0b876682-f461-4a01-bf54-6de1caf1ec44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:35.347438 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0b876682-f461-4a01-bf54-6de1caf1ec44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:35.355009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b876682-f461-4a01-bf54-6de1caf1ec44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:35.355466 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b876682-f461-4a01-bf54-6de1caf1ec44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:35.356251 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b876682-f461-4a01-bf54-6de1caf1ec44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:35.356684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b876682-f461-4a01-bf54-6de1caf1ec44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:35.446973 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bef140ed-af6d-4675-8878-3334f566962a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:35.459296 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bef140ed-af6d-4675-8878-3334f566962a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.222166 Aug 13 04:30:35.460693 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 79/171] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:35 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:35.567286 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0b876682-f461-4a01-bf54-6de1caf1ec44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:35.580843 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0b876682-f461-4a01-bf54-6de1caf1ec44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:35.589019 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0b876682-f461-4a01-bf54-6de1caf1ec44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:35.596670 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0b876682-f461-4a01-bf54-6de1caf1ec44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.249030 Aug 13 04:30:35.596670 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 93/172] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:35 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:30:35.818265 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a356c21f-9158-476a-89e1-df50f720f537 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:35.819482 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a356c21f-9158-476a-89e1-df50f720f537 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:35.830531 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a356c21f-9158-476a-89e1-df50f720f537 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:35.831264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a356c21f-9158-476a-89e1-df50f720f537 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:35.832220 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a356c21f-9158-476a-89e1-df50f720f537 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:35.834216 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a356c21f-9158-476a-89e1-df50f720f537 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:35.932788 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1a1faf1d-9805-4677-a4d7-109d72625a20 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:35.933525 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1a1faf1d-9805-4677-a4d7-109d72625a20 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:35.940074 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a1faf1d-9805-4677-a4d7-109d72625a20 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:35.940717 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a1faf1d-9805-4677-a4d7-109d72625a20 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:35.942607 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a1faf1d-9805-4677-a4d7-109d72625a20 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:35.943238 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a1faf1d-9805-4677-a4d7-109d72625a20 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:35.981474 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a356c21f-9158-476a-89e1-df50f720f537 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:35.989397 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a356c21f-9158-476a-89e1-df50f720f537 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.174670 Aug 13 04:30:36.000342 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 80/173] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:35 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:36.082141 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1a1faf1d-9805-4677-a4d7-109d72625a20 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:36.089863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1a1faf1d-9805-4677-a4d7-109d72625a20 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.161743 Aug 13 04:30:36.090706 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 94/174] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:35 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:36.476570 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4a9fb997-a03c-49ce-9fe4-bcc109acc930 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:36.477937 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4a9fb997-a03c-49ce-9fe4-bcc109acc930 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:36.483865 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a9fb997-a03c-49ce-9fe4-bcc109acc930 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:36.484305 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a9fb997-a03c-49ce-9fe4-bcc109acc930 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:36.485060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a9fb997-a03c-49ce-9fe4-bcc109acc930 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:36.485526 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a9fb997-a03c-49ce-9fe4-bcc109acc930 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:36.610065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4a9fb997-a03c-49ce-9fe4-bcc109acc930 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:36.613669 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-163097e0-ee6f-4f4b-befb-cc555c0bb2ee tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:36.614280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-163097e0-ee6f-4f4b-befb-cc555c0bb2ee tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:36.617952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4a9fb997-a03c-49ce-9fe4-bcc109acc930 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.144503 Aug 13 04:30:36.618524 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 81/175] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:36 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:36.621249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-163097e0-ee6f-4f4b-befb-cc555c0bb2ee tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:36.621723 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-163097e0-ee6f-4f4b-befb-cc555c0bb2ee tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:36.622494 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-163097e0-ee6f-4f4b-befb-cc555c0bb2ee tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:36.622922 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-163097e0-ee6f-4f4b-befb-cc555c0bb2ee tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:36.741690 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-163097e0-ee6f-4f4b-befb-cc555c0bb2ee tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:36.750318 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-163097e0-ee6f-4f4b-befb-cc555c0bb2ee tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:36.751823 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-163097e0-ee6f-4f4b-befb-cc555c0bb2ee tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:36.752952 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-163097e0-ee6f-4f4b-befb-cc555c0bb2ee tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.143032 Aug 13 04:30:36.753539 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 95/176] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:36 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:30:37.007593 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f311e473-252c-4ed2-8ec3-29b8da5db115 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:37.008765 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f311e473-252c-4ed2-8ec3-29b8da5db115 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:37.014974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f311e473-252c-4ed2-8ec3-29b8da5db115 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:37.015420 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f311e473-252c-4ed2-8ec3-29b8da5db115 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:37.016189 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f311e473-252c-4ed2-8ec3-29b8da5db115 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:37.016618 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f311e473-252c-4ed2-8ec3-29b8da5db115 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:37.106710 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-351bfadb-a165-4c7f-a487-da804774ce71 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:37.107328 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-351bfadb-a165-4c7f-a487-da804774ce71 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:37.113102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-351bfadb-a165-4c7f-a487-da804774ce71 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:37.113580 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-351bfadb-a165-4c7f-a487-da804774ce71 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:37.114360 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-351bfadb-a165-4c7f-a487-da804774ce71 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:37.114865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-351bfadb-a165-4c7f-a487-da804774ce71 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:37.136272 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f311e473-252c-4ed2-8ec3-29b8da5db115 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:37.143479 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f311e473-252c-4ed2-8ec3-29b8da5db115 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.139607 Aug 13 04:30:37.144242 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 82/177] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:37 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:37.244763 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-351bfadb-a165-4c7f-a487-da804774ce71 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:37.251823 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-351bfadb-a165-4c7f-a487-da804774ce71 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.148705 Aug 13 04:30:37.252384 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 96/178] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:37 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:37.635150 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d8ba33b5-0f69-4456-bf8e-9ad036281c47 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:37.635767 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d8ba33b5-0f69-4456-bf8e-9ad036281c47 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:37.641971 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d8ba33b5-0f69-4456-bf8e-9ad036281c47 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:37.642424 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d8ba33b5-0f69-4456-bf8e-9ad036281c47 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:37.643200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d8ba33b5-0f69-4456-bf8e-9ad036281c47 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:37.643638 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d8ba33b5-0f69-4456-bf8e-9ad036281c47 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:37.762243 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d8ba33b5-0f69-4456-bf8e-9ad036281c47 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:37.769827 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d8ba33b5-0f69-4456-bf8e-9ad036281c47 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.138685 Aug 13 04:30:37.770388 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 83/179] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:37 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:37.771049 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9ae5e0f9-5f38-44bc-b108-f209054d7b25 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:37.771658 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9ae5e0f9-5f38-44bc-b108-f209054d7b25 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:37.778380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ae5e0f9-5f38-44bc-b108-f209054d7b25 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:37.778823 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ae5e0f9-5f38-44bc-b108-f209054d7b25 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:37.780021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ae5e0f9-5f38-44bc-b108-f209054d7b25 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:37.780021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ae5e0f9-5f38-44bc-b108-f209054d7b25 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:37.905346 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9ae5e0f9-5f38-44bc-b108-f209054d7b25 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:37.913436 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9ae5e0f9-5f38-44bc-b108-f209054d7b25 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:37.915555 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9ae5e0f9-5f38-44bc-b108-f209054d7b25 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:37.916637 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9ae5e0f9-5f38-44bc-b108-f209054d7b25 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.149230 Aug 13 04:30:37.917189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 97/180] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:37 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:30:38.165715 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-45e6d50c-01fc-4043-9e56-392a7751e91f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:38.167545 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-45e6d50c-01fc-4043-9e56-392a7751e91f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:38.176117 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-45e6d50c-01fc-4043-9e56-392a7751e91f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:38.176596 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-45e6d50c-01fc-4043-9e56-392a7751e91f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:38.177516 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-45e6d50c-01fc-4043-9e56-392a7751e91f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:38.178146 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-45e6d50c-01fc-4043-9e56-392a7751e91f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:38.270001 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ffa134c0-acd1-4fd3-9347-2f34a257572a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:38.270837 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ffa134c0-acd1-4fd3-9347-2f34a257572a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:38.276839 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ffa134c0-acd1-4fd3-9347-2f34a257572a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:38.277302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ffa134c0-acd1-4fd3-9347-2f34a257572a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:38.278114 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ffa134c0-acd1-4fd3-9347-2f34a257572a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:38.278549 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ffa134c0-acd1-4fd3-9347-2f34a257572a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:38.358301 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-45e6d50c-01fc-4043-9e56-392a7751e91f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:38.374065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-45e6d50c-01fc-4043-9e56-392a7751e91f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.216509 Aug 13 04:30:38.386870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 84/181] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:38 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:38.452062 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ffa134c0-acd1-4fd3-9347-2f34a257572a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:38.466452 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ffa134c0-acd1-4fd3-9347-2f34a257572a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.200287 Aug 13 04:30:38.467915 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 98/182] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:38 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:38.792500 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-34aff6aa-85c7-4dc9-a468-d03ba13379c8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:38.794476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-34aff6aa-85c7-4dc9-a468-d03ba13379c8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:38.813865 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34aff6aa-85c7-4dc9-a468-d03ba13379c8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:38.814437 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34aff6aa-85c7-4dc9-a468-d03ba13379c8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:38.815221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34aff6aa-85c7-4dc9-a468-d03ba13379c8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:38.815658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34aff6aa-85c7-4dc9-a468-d03ba13379c8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:38.938416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-bfd218ff-003e-48e6-a6f5-3a24366e2899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:38.939273 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-bfd218ff-003e-48e6-a6f5-3a24366e2899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:38.947545 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bfd218ff-003e-48e6-a6f5-3a24366e2899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:38.948142 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bfd218ff-003e-48e6-a6f5-3a24366e2899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:38.949212 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bfd218ff-003e-48e6-a6f5-3a24366e2899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:38.949750 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bfd218ff-003e-48e6-a6f5-3a24366e2899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:39.294338 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-34aff6aa-85c7-4dc9-a468-d03ba13379c8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:39.299011 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-bfd218ff-003e-48e6-a6f5-3a24366e2899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:39.303203 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-34aff6aa-85c7-4dc9-a468-d03ba13379c8 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.519346 Aug 13 04:30:39.303779 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 85/183] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:38 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:39.307305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-bfd218ff-003e-48e6-a6f5-3a24366e2899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:39.308787 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-bfd218ff-003e-48e6-a6f5-3a24366e2899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:39.309889 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-bfd218ff-003e-48e6-a6f5-3a24366e2899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.378557 Aug 13 04:30:39.310439 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 99/184] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:38 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:39.399228 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4d900de0-2374-475a-9f08-f944df48e067 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:39.400482 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4d900de0-2374-475a-9f08-f944df48e067 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:39.408033 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d900de0-2374-475a-9f08-f944df48e067 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:39.408549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d900de0-2374-475a-9f08-f944df48e067 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:39.409396 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d900de0-2374-475a-9f08-f944df48e067 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:39.409930 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d900de0-2374-475a-9f08-f944df48e067 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:39.486074 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-33fc1213-95af-4920-9101-fdcfb1d7930d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:39.486695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-33fc1213-95af-4920-9101-fdcfb1d7930d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:39.492721 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33fc1213-95af-4920-9101-fdcfb1d7930d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:39.493168 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33fc1213-95af-4920-9101-fdcfb1d7930d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:39.494322 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33fc1213-95af-4920-9101-fdcfb1d7930d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:39.494752 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33fc1213-95af-4920-9101-fdcfb1d7930d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:39.552166 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4d900de0-2374-475a-9f08-f944df48e067 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:39.559510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4d900de0-2374-475a-9f08-f944df48e067 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.164654 Aug 13 04:30:39.560280 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 86/185] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:39 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:39.640286 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-33fc1213-95af-4920-9101-fdcfb1d7930d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:39.650274 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-33fc1213-95af-4920-9101-fdcfb1d7930d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.167875 Aug 13 04:30:39.651029 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 100/186] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:39 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:40.322415 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bb79a744-fd64-48ad-b408-d2af2fce1364 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:40.323851 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bb79a744-fd64-48ad-b408-d2af2fce1364 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:40.329754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-35ceac80-9cfb-4ac5-8f6f-834c5500f643 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:40.330584 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-35ceac80-9cfb-4ac5-8f6f-834c5500f643 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:40.332876 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bb79a744-fd64-48ad-b408-d2af2fce1364 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:40.337535 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bb79a744-fd64-48ad-b408-d2af2fce1364 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:40.338918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bb79a744-fd64-48ad-b408-d2af2fce1364 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:40.342425 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bb79a744-fd64-48ad-b408-d2af2fce1364 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:40.343058 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-35ceac80-9cfb-4ac5-8f6f-834c5500f643 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:40.343581 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-35ceac80-9cfb-4ac5-8f6f-834c5500f643 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:40.346312 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-35ceac80-9cfb-4ac5-8f6f-834c5500f643 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:40.346773 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-35ceac80-9cfb-4ac5-8f6f-834c5500f643 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:40.745338 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-35ceac80-9cfb-4ac5-8f6f-834c5500f643 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:40.761010 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-35ceac80-9cfb-4ac5-8f6f-834c5500f643 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:40.777737 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-35ceac80-9cfb-4ac5-8f6f-834c5500f643 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:40.777737 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-35ceac80-9cfb-4ac5-8f6f-834c5500f643 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.446519 Aug 13 04:30:40.788378 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 101/187] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:40 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:40.793158 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bb79a744-fd64-48ad-b408-d2af2fce1364 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:40.809088 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bb79a744-fd64-48ad-b408-d2af2fce1364 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.492335 Aug 13 04:30:40.825150 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 87/188] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:40 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 509 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:40.832721 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-24ccbde4-8598-4ad5-89c8-98f5d74818eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:40.834156 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-24ccbde4-8598-4ad5-89c8-98f5d74818eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:40.844566 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-24ccbde4-8598-4ad5-89c8-98f5d74818eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:40.846602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-24ccbde4-8598-4ad5-89c8-98f5d74818eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:40.848610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-24ccbde4-8598-4ad5-89c8-98f5d74818eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:40.849389 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-24ccbde4-8598-4ad5-89c8-98f5d74818eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:41.156953 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-be8479c6-9b98-4a9b-9da7-e1b9edad8807 req-f680e546-b387-44b9-abfb-cc151cda68eb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d299e5c1-cd60-4057-93a3-5d32e1908d2f", "name": "network-vif-plugged", "status": "completed", "tag": "c3be48be-e5ee-48ea-a418-bc6c5c7a337c"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:41.159713 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:30:41.159713 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:30:41.172588 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-24ccbde4-8598-4ad5-89c8-98f5d74818eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:41.181552 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-be8479c6-9b98-4a9b-9da7-e1b9edad8807 req-f680e546-b387-44b9-abfb-cc151cda68eb service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:41.182601 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-be8479c6-9b98-4a9b-9da7-e1b9edad8807 req-f680e546-b387-44b9-abfb-cc151cda68eb service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:41.197759 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-24ccbde4-8598-4ad5-89c8-98f5d74818eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.370811 Aug 13 04:30:41.198352 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 88/189] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:40 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 372 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:41.204411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-265f0b4a-8bb4-4bf4-b267-7d2887c729de tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:41.205049 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-265f0b4a-8bb4-4bf4-b267-7d2887c729de tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:41.211711 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-be8479c6-9b98-4a9b-9da7-e1b9edad8807 req-f680e546-b387-44b9-abfb-cc151cda68eb service nova] Creating event network-vif-plugged:c3be48be-e5ee-48ea-a418-bc6c5c7a337c for instance d299e5c1-cd60-4057-93a3-5d32e1908d2f on hv-cinder-75996 Aug 13 04:30:41.219218 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-265f0b4a-8bb4-4bf4-b267-7d2887c729de tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:41.220618 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-be8479c6-9b98-4a9b-9da7-e1b9edad8807 req-f680e546-b387-44b9-abfb-cc151cda68eb service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.429593 Aug 13 04:30:41.221454 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 102/190] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:30:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:30:41.221707 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-265f0b4a-8bb4-4bf4-b267-7d2887c729de tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:41.225822 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-265f0b4a-8bb4-4bf4-b267-7d2887c729de tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:41.227149 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-265f0b4a-8bb4-4bf4-b267-7d2887c729de tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:41.438915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-265f0b4a-8bb4-4bf4-b267-7d2887c729de tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:41.452324 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-265f0b4a-8bb4-4bf4-b267-7d2887c729de tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.251707 Aug 13 04:30:41.453243 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 89/191] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:41 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:41.791217 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-151928cb-d9ed-47e7-a6d3-ebb915ba614c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:41.792003 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-151928cb-d9ed-47e7-a6d3-ebb915ba614c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:41.810283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-151928cb-d9ed-47e7-a6d3-ebb915ba614c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:41.815486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-151928cb-d9ed-47e7-a6d3-ebb915ba614c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:41.816691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-151928cb-d9ed-47e7-a6d3-ebb915ba614c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:41.817221 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-151928cb-d9ed-47e7-a6d3-ebb915ba614c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:41.830490 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5a866a53-7458-4c7a-aef8-4248619cbad0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:41.831445 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5a866a53-7458-4c7a-aef8-4248619cbad0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:41.845904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5a866a53-7458-4c7a-aef8-4248619cbad0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:41.847660 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5a866a53-7458-4c7a-aef8-4248619cbad0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:41.850086 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5a866a53-7458-4c7a-aef8-4248619cbad0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:41.851154 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5a866a53-7458-4c7a-aef8-4248619cbad0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:42.196999 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-151928cb-d9ed-47e7-a6d3-ebb915ba614c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:42.212375 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-151928cb-d9ed-47e7-a6d3-ebb915ba614c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:42.214199 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-151928cb-d9ed-47e7-a6d3-ebb915ba614c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:42.225102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-151928cb-d9ed-47e7-a6d3-ebb915ba614c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.437449 Aug 13 04:30:42.228665 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 103/192] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:41 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:30:42.233937 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5a866a53-7458-4c7a-aef8-4248619cbad0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:42.246633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5a866a53-7458-4c7a-aef8-4248619cbad0 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.420891 Aug 13 04:30:42.253171 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-13aad08b-0377-46ed-8c6b-5d4f44683275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:42.253863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-13aad08b-0377-46ed-8c6b-5d4f44683275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:42.262957 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13aad08b-0377-46ed-8c6b-5d4f44683275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:42.263569 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 90/193] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:41 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:42.263973 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13aad08b-0377-46ed-8c6b-5d4f44683275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:42.264993 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13aad08b-0377-46ed-8c6b-5d4f44683275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:42.265480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13aad08b-0377-46ed-8c6b-5d4f44683275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:42.428637 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-13aad08b-0377-46ed-8c6b-5d4f44683275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:42.437646 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-13aad08b-0377-46ed-8c6b-5d4f44683275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.191409 Aug 13 04:30:42.438801 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 104/194] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:42 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:42.471558 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f4ca0d8d-177c-41db-a7fe-3075d72e6696 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:42.472430 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f4ca0d8d-177c-41db-a7fe-3075d72e6696 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:42.478676 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4ca0d8d-177c-41db-a7fe-3075d72e6696 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:42.479296 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4ca0d8d-177c-41db-a7fe-3075d72e6696 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:42.480160 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4ca0d8d-177c-41db-a7fe-3075d72e6696 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:42.480649 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4ca0d8d-177c-41db-a7fe-3075d72e6696 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:42.656634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f4ca0d8d-177c-41db-a7fe-3075d72e6696 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:42.666981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f4ca0d8d-177c-41db-a7fe-3075d72e6696 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.199706 Aug 13 04:30:42.667993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 91/195] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:42 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:43.245452 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-42054619-8c8f-4e8a-9f41-8b6de3aa2a8e req-b44654d9-b316-4790-8ce1-6325903fbb99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0662f42-e77d-4f85-84ad-b58befdc445d", "name": "network-vif-plugged", "status": "completed", "tag": "f5bada29-7024-47b0-b3dd-d142dd41cdda"}, {"server_uuid": "47f20e62-089b-4313-bad1-6139880e21cd", "name": "network-vif-plugged", "status": "completed", "tag": "7ac239ef-8a51-4298-8f3f-3e873f6190de"}, {"server_uuid": "4efb80e9-e2d4-416d-ad9d-3957beb33d56", "name": "network-vif-plugged", "status": "completed", "tag": "4a62d4b3-3837-414b-a01d-079fec907da0"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:43.248944 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:30:43.248944 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:30:43.252433 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-184f7ca1-751a-4834-9cf5-b75ac73b611c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:43.253229 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-184f7ca1-751a-4834-9cf5-b75ac73b611c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:43.260886 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-42054619-8c8f-4e8a-9f41-8b6de3aa2a8e req-b44654d9-b316-4790-8ce1-6325903fbb99 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:43.261321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-42054619-8c8f-4e8a-9f41-8b6de3aa2a8e req-b44654d9-b316-4790-8ce1-6325903fbb99 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:43.262577 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-184f7ca1-751a-4834-9cf5-b75ac73b611c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:43.263252 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-184f7ca1-751a-4834-9cf5-b75ac73b611c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:43.264425 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-184f7ca1-751a-4834-9cf5-b75ac73b611c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:43.265419 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-184f7ca1-751a-4834-9cf5-b75ac73b611c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:43.278817 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-42054619-8c8f-4e8a-9f41-8b6de3aa2a8e req-b44654d9-b316-4790-8ce1-6325903fbb99 service nova] Creating event network-vif-plugged:f5bada29-7024-47b0-b3dd-d142dd41cdda for instance a0662f42-e77d-4f85-84ad-b58befdc445d on hv-cinder-75996 Aug 13 04:30:43.279313 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-42054619-8c8f-4e8a-9f41-8b6de3aa2a8e req-b44654d9-b316-4790-8ce1-6325903fbb99 service nova] Creating event network-vif-plugged:7ac239ef-8a51-4298-8f3f-3e873f6190de for instance 47f20e62-089b-4313-bad1-6139880e21cd on hv-cinder-75996 Aug 13 04:30:43.279800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-42054619-8c8f-4e8a-9f41-8b6de3aa2a8e req-b44654d9-b316-4790-8ce1-6325903fbb99 service nova] Creating event network-vif-plugged:4a62d4b3-3837-414b-a01d-079fec907da0 for instance 4efb80e9-e2d4-416d-ad9d-3957beb33d56 on hv-cinder-75996 Aug 13 04:30:43.289881 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-42054619-8c8f-4e8a-9f41-8b6de3aa2a8e req-b44654d9-b316-4790-8ce1-6325903fbb99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 525 microversion: 2.1 time: 0.051682 Aug 13 04:30:43.291399 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 105/196] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:30:43 2021] POST /compute/v2.1/os-server-external-events => generated 525 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:30:43.298973 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e540b6e8-40af-4783-afbe-8b4420be13a6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:43.299679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e540b6e8-40af-4783-afbe-8b4420be13a6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:43.314878 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e540b6e8-40af-4783-afbe-8b4420be13a6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:43.315435 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e540b6e8-40af-4783-afbe-8b4420be13a6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:43.316209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e540b6e8-40af-4783-afbe-8b4420be13a6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:43.316893 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e540b6e8-40af-4783-afbe-8b4420be13a6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:43.553395 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-184f7ca1-751a-4834-9cf5-b75ac73b611c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:43.565311 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-184f7ca1-751a-4834-9cf5-b75ac73b611c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:43.568394 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-184f7ca1-751a-4834-9cf5-b75ac73b611c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:43.570067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-184f7ca1-751a-4834-9cf5-b75ac73b611c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1407 microversion: 2.20 time: 0.321716 Aug 13 04:30:43.571376 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 92/197] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:43 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1407 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:43.576495 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-552a5453-e361-486e-9617-126a568ba8c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:43.577361 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-552a5453-e361-486e-9617-126a568ba8c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:43.585959 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-552a5453-e361-486e-9617-126a568ba8c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:43.587017 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-552a5453-e361-486e-9617-126a568ba8c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:43.588105 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-552a5453-e361-486e-9617-126a568ba8c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:43.588745 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-552a5453-e361-486e-9617-126a568ba8c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:43.638594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e540b6e8-40af-4783-afbe-8b4420be13a6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:43.669508 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e540b6e8-40af-4783-afbe-8b4420be13a6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.375701 Aug 13 04:30:43.688662 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 106/198] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:43 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:43.694404 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-da9ec4bf-ad85-4692-8247-7e2b7875401e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:43.695664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-da9ec4bf-ad85-4692-8247-7e2b7875401e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:43.715593 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-da9ec4bf-ad85-4692-8247-7e2b7875401e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:43.716122 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-da9ec4bf-ad85-4692-8247-7e2b7875401e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:43.717960 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-da9ec4bf-ad85-4692-8247-7e2b7875401e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:43.718407 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-da9ec4bf-ad85-4692-8247-7e2b7875401e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:43.934884 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-552a5453-e361-486e-9617-126a568ba8c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:43.947204 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-552a5453-e361-486e-9617-126a568ba8c1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.373975 Aug 13 04:30:43.949268 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 93/199] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:43 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:44.078492 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-da9ec4bf-ad85-4692-8247-7e2b7875401e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:44.089839 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-da9ec4bf-ad85-4692-8247-7e2b7875401e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.399215 Aug 13 04:30:44.090764 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 107/200] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:43 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:44.595401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9ee4bacb-9167-46c5-9ae2-477410fdfa27 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:44.600001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9ee4bacb-9167-46c5-9ae2-477410fdfa27 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:44.634705 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9ee4bacb-9167-46c5-9ae2-477410fdfa27 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:44.635823 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9ee4bacb-9167-46c5-9ae2-477410fdfa27 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:44.637334 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9ee4bacb-9167-46c5-9ae2-477410fdfa27 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:44.641769 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9ee4bacb-9167-46c5-9ae2-477410fdfa27 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:44.699332 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-39367ba5-a2a6-4880-8372-853487aa03ea tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:44.700117 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-39367ba5-a2a6-4880-8372-853487aa03ea tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:44.713058 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-39367ba5-a2a6-4880-8372-853487aa03ea tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:44.714082 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-39367ba5-a2a6-4880-8372-853487aa03ea tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:44.715797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-39367ba5-a2a6-4880-8372-853487aa03ea tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:44.716696 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-39367ba5-a2a6-4880-8372-853487aa03ea tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:44.890094 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9ee4bacb-9167-46c5-9ae2-477410fdfa27 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:44.911795 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9ee4bacb-9167-46c5-9ae2-477410fdfa27 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:44.920108 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9ee4bacb-9167-46c5-9ae2-477410fdfa27 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:44.937249 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9ee4bacb-9167-46c5-9ae2-477410fdfa27 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1597 microversion: 2.20 time: 0.339758 Aug 13 04:30:44.939087 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 94/201] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:30:44 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1597 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:30:44.969367 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a8672452-e61e-4e4b-a406-567e21f6d8b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:44.970236 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a8672452-e61e-4e4b-a406-567e21f6d8b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:44.981623 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8672452-e61e-4e4b-a406-567e21f6d8b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:44.983567 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8672452-e61e-4e4b-a406-567e21f6d8b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:44.984853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8672452-e61e-4e4b-a406-567e21f6d8b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:44.985549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8672452-e61e-4e4b-a406-567e21f6d8b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:45.058073 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-39367ba5-a2a6-4880-8372-853487aa03ea tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:45.067256 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-39367ba5-a2a6-4880-8372-853487aa03ea tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1314 microversion: 2.1 time: 0.373057 Aug 13 04:30:45.069265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 108/202] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:44 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:45.074478 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ea5e4f98-86e5-4c6f-96b9-eaa45e5f39ff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:45.075388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ea5e4f98-86e5-4c6f-96b9-eaa45e5f39ff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:45.081707 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ea5e4f98-86e5-4c6f-96b9-eaa45e5f39ff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:45.082519 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ea5e4f98-86e5-4c6f-96b9-eaa45e5f39ff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:45.083389 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ea5e4f98-86e5-4c6f-96b9-eaa45e5f39ff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:45.084012 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ea5e4f98-86e5-4c6f-96b9-eaa45e5f39ff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:45.251470 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a8672452-e61e-4e4b-a406-567e21f6d8b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.298423 Aug 13 04:30:45.253648 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 95/203] 10.222.0.13 () {60 vars in 1316 bytes} [Fri Aug 13 04:30:44 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-interface => generated 284 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:30:45.259683 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9e73b7ce-60c7-49e0-aaee-979f9cf24d6b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:45.261459 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9e73b7ce-60c7-49e0-aaee-979f9cf24d6b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:45.270213 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9e73b7ce-60c7-49e0-aaee-979f9cf24d6b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:45.271015 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9e73b7ce-60c7-49e0-aaee-979f9cf24d6b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:45.272088 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9e73b7ce-60c7-49e0-aaee-979f9cf24d6b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:45.273333 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9e73b7ce-60c7-49e0-aaee-979f9cf24d6b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:45.378494 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ea5e4f98-86e5-4c6f-96b9-eaa45e5f39ff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:45.402222 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ea5e4f98-86e5-4c6f-96b9-eaa45e5f39ff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1362 microversion: 2.1 time: 0.330835 Aug 13 04:30:45.402593 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 109/204] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:45 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1362 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:45.478225 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9e73b7ce-60c7-49e0-aaee-979f9cf24d6b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:45.493413 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9e73b7ce-60c7-49e0-aaee-979f9cf24d6b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1318 microversion: 2.1 time: 0.237688 Aug 13 04:30:45.493879 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 96/205] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:45 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1318 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:46.094479 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-02e62880-ea77-4fb5-8338-efccd00c8d13 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:46.098392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-02e62880-ea77-4fb5-8338-efccd00c8d13 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:46.113656 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02e62880-ea77-4fb5-8338-efccd00c8d13 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:46.114782 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02e62880-ea77-4fb5-8338-efccd00c8d13 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:46.116456 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02e62880-ea77-4fb5-8338-efccd00c8d13 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:46.118876 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02e62880-ea77-4fb5-8338-efccd00c8d13 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:46.307780 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-02e62880-ea77-4fb5-8338-efccd00c8d13 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:46.318302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-02e62880-ea77-4fb5-8338-efccd00c8d13 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1501 microversion: 2.1 time: 0.234241 Aug 13 04:30:46.319434 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 110/206] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:46 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1501 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:46.424568 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f81323d0-a222-4861-ae86-fadf87f94927 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:46.426028 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f81323d0-a222-4861-ae86-fadf87f94927 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:46.432879 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f81323d0-a222-4861-ae86-fadf87f94927 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:46.433607 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f81323d0-a222-4861-ae86-fadf87f94927 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:46.434544 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f81323d0-a222-4861-ae86-fadf87f94927 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:46.435114 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f81323d0-a222-4861-ae86-fadf87f94927 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:46.521415 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f4be4a86-8f9b-4d1b-bceb-17aefff58a04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:46.522290 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f4be4a86-8f9b-4d1b-bceb-17aefff58a04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:46.529777 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f4be4a86-8f9b-4d1b-bceb-17aefff58a04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:46.530734 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f4be4a86-8f9b-4d1b-bceb-17aefff58a04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:46.532117 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f4be4a86-8f9b-4d1b-bceb-17aefff58a04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:46.533364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f4be4a86-8f9b-4d1b-bceb-17aefff58a04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:47.111012 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f81323d0-a222-4861-ae86-fadf87f94927 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:47.123403 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f81323d0-a222-4861-ae86-fadf87f94927 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1547 microversion: 2.1 time: 0.703131 Aug 13 04:30:47.124570 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 97/207] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:46 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1547 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:47.141321 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c04c1faa-14fc-4d9e-afe2-db0841b8123a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:47.141865 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c04c1faa-14fc-4d9e-afe2-db0841b8123a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:47.158434 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c04c1faa-14fc-4d9e-afe2-db0841b8123a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:47.159383 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c04c1faa-14fc-4d9e-afe2-db0841b8123a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:47.160377 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c04c1faa-14fc-4d9e-afe2-db0841b8123a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:47.160808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c04c1faa-14fc-4d9e-afe2-db0841b8123a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:47.243640 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f4be4a86-8f9b-4d1b-bceb-17aefff58a04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:47.263629 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f4be4a86-8f9b-4d1b-bceb-17aefff58a04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1508 microversion: 2.1 time: 0.751652 Aug 13 04:30:47.264279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 111/208] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:46 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1508 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:47.403248 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c04c1faa-14fc-4d9e-afe2-db0841b8123a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.265712 Aug 13 04:30:47.404324 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 98/209] 10.222.0.13 () {58 vars in 1275 bytes} [Fri Aug 13 04:30:47 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/os-interface => generated 284 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:30:48.190441 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-14caaad9-59ab-429a-a82f-7528511ad636 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "82f3f718-31d5-47ed-adf6-ddb571633f3d"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:48.191586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-14caaad9-59ab-429a-a82f-7528511ad636 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:48.208683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14caaad9-59ab-429a-a82f-7528511ad636 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:48.214643 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14caaad9-59ab-429a-a82f-7528511ad636 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:48.215382 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14caaad9-59ab-429a-a82f-7528511ad636 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:48.218904 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14caaad9-59ab-429a-a82f-7528511ad636 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:48.222325 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b1aa680b-575f-4b83-b55c-0f33487cf586 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:48.224183 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b1aa680b-575f-4b83-b55c-0f33487cf586 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:48.237073 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1aa680b-575f-4b83-b55c-0f33487cf586 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:48.238162 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1aa680b-575f-4b83-b55c-0f33487cf586 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:48.239606 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1aa680b-575f-4b83-b55c-0f33487cf586 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:48.243485 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1aa680b-575f-4b83-b55c-0f33487cf586 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:48.368143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b1aa680b-575f-4b83-b55c-0f33487cf586 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.150237 Aug 13 04:30:48.372693 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 99/210] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:48 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:48.386216 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-7d4c7e1d-67de-409d-b9a9-08db83cafa47 req-35124803-9ec8-432f-9f68-07cd03692b3e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d299e5c1-cd60-4057-93a3-5d32e1908d2f", "tag": "c3be48be-e5ee-48ea-a418-bc6c5c7a337c"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:48.389852 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:30:48.389852 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:30:48.415833 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-7d4c7e1d-67de-409d-b9a9-08db83cafa47 req-35124803-9ec8-432f-9f68-07cd03692b3e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:48.415833 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-7d4c7e1d-67de-409d-b9a9-08db83cafa47 req-35124803-9ec8-432f-9f68-07cd03692b3e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:48.439150 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-7d4c7e1d-67de-409d-b9a9-08db83cafa47 req-35124803-9ec8-432f-9f68-07cd03692b3e service nova] Creating event network-changed:c3be48be-e5ee-48ea-a418-bc6c5c7a337c for instance d299e5c1-cd60-4057-93a3-5d32e1908d2f on hv-cinder-75996 Aug 13 04:30:48.451375 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-7d4c7e1d-67de-409d-b9a9-08db83cafa47 req-35124803-9ec8-432f-9f68-07cd03692b3e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078824 Aug 13 04:30:48.452106 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 100/211] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:30:48 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:30:48.882401 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-14caaad9-59ab-429a-a82f-7528511ad636 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "POST /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.696852 Aug 13 04:30:48.886104 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 112/212] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:30:48 2021] POST /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd/os-volume_attachments => generated 194 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:30:49.309989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bd7c4e0d-e571-4406-9510-1e5944b02ad7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69ca6413-ed76-423e-a5ff-2aa36241d555"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:49.311185 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bd7c4e0d-e571-4406-9510-1e5944b02ad7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:49.326100 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd7c4e0d-e571-4406-9510-1e5944b02ad7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:49.329357 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd7c4e0d-e571-4406-9510-1e5944b02ad7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:49.333255 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd7c4e0d-e571-4406-9510-1e5944b02ad7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:49.338050 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd7c4e0d-e571-4406-9510-1e5944b02ad7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:49.380996 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7c8bf87f-e54e-4a9e-a6d3-0cb60f715b7c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:49.381999 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7c8bf87f-e54e-4a9e-a6d3-0cb60f715b7c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:49.396486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7c8bf87f-e54e-4a9e-a6d3-0cb60f715b7c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:49.396950 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7c8bf87f-e54e-4a9e-a6d3-0cb60f715b7c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:49.406040 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7c8bf87f-e54e-4a9e-a6d3-0cb60f715b7c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:49.406526 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7c8bf87f-e54e-4a9e-a6d3-0cb60f715b7c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:49.496787 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7c8bf87f-e54e-4a9e-a6d3-0cb60f715b7c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.119813 Aug 13 04:30:49.498055 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 113/213] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:49 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:49.790284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bd7c4e0d-e571-4406-9510-1e5944b02ad7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "POST /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.484312 Aug 13 04:30:49.791742 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 101/214] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:30:49 2021] POST /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments => generated 194 bytes in 487 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:30:50.509615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-93212a59-157b-46b5-b2bc-f37bcddb73e3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:50.510819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-93212a59-157b-46b5-b2bc-f37bcddb73e3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:50.526594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-93212a59-157b-46b5-b2bc-f37bcddb73e3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:50.528615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-93212a59-157b-46b5-b2bc-f37bcddb73e3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:50.530492 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-93212a59-157b-46b5-b2bc-f37bcddb73e3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:50.531389 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-93212a59-157b-46b5-b2bc-f37bcddb73e3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:50.677163 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-93212a59-157b-46b5-b2bc-f37bcddb73e3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.172858 Aug 13 04:30:50.677956 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 114/215] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:50 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:50.737475 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-155998be-6111-4e12-b7ed-7bbf34fb86ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:50.738610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-155998be-6111-4e12-b7ed-7bbf34fb86ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:50.748395 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-7477318d-5bd5-45a0-9abb-9ea34750e179 req-5076ae53-10dd-4c0c-b424-014f9765be66 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a0662f42-e77d-4f85-84ad-b58befdc445d", "tag": "f5bada29-7024-47b0-b3dd-d142dd41cdda"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:50.750035 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:30:50.750035 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:30:50.756767 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-155998be-6111-4e12-b7ed-7bbf34fb86ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:50.756767 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-155998be-6111-4e12-b7ed-7bbf34fb86ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:50.757313 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-155998be-6111-4e12-b7ed-7bbf34fb86ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:50.758182 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-155998be-6111-4e12-b7ed-7bbf34fb86ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:50.767065 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-7477318d-5bd5-45a0-9abb-9ea34750e179 req-5076ae53-10dd-4c0c-b424-014f9765be66 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:50.767904 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-7477318d-5bd5-45a0-9abb-9ea34750e179 req-5076ae53-10dd-4c0c-b424-014f9765be66 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:50.795628 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-7477318d-5bd5-45a0-9abb-9ea34750e179 req-5076ae53-10dd-4c0c-b424-014f9765be66 service nova] Creating event network-changed:f5bada29-7024-47b0-b3dd-d142dd41cdda for instance a0662f42-e77d-4f85-84ad-b58befdc445d on hv-cinder-75996 Aug 13 04:30:50.805166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-7477318d-5bd5-45a0-9abb-9ea34750e179 req-5076ae53-10dd-4c0c-b424-014f9765be66 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059501 Aug 13 04:30:50.805846 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 115/216] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:30:50 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:30:50.897694 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-155998be-6111-4e12-b7ed-7bbf34fb86ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14 microversion: 2.1 time: 0.165981 Aug 13 04:30:50.899579 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 102/217] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:30:50 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:30:51.689028 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-149621e1-8873-4a66-9f1e-1b39794192f9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:51.691074 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-149621e1-8873-4a66-9f1e-1b39794192f9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:51.700627 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-149621e1-8873-4a66-9f1e-1b39794192f9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:51.702973 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-149621e1-8873-4a66-9f1e-1b39794192f9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:51.703934 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-149621e1-8873-4a66-9f1e-1b39794192f9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:51.706527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-149621e1-8873-4a66-9f1e-1b39794192f9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:51.807471 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-149621e1-8873-4a66-9f1e-1b39794192f9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.122313 Aug 13 04:30:51.813162 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 116/218] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:51 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:51.909885 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-14497218-07a0-4d1b-8d64-5d56f68cac12 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:51.911061 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-14497218-07a0-4d1b-8d64-5d56f68cac12 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:51.920452 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-14497218-07a0-4d1b-8d64-5d56f68cac12 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:51.923237 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-14497218-07a0-4d1b-8d64-5d56f68cac12 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:51.924196 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-14497218-07a0-4d1b-8d64-5d56f68cac12 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:51.924487 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-14497218-07a0-4d1b-8d64-5d56f68cac12 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:52.004902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-14497218-07a0-4d1b-8d64-5d56f68cac12 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14 microversion: 2.1 time: 0.098888 Aug 13 04:30:52.006342 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 103/219] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:30:51 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:30:52.821307 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b3f3655e-5026-435f-8869-6f17cb1ed23e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:52.822229 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b3f3655e-5026-435f-8869-6f17cb1ed23e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:52.828617 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3f3655e-5026-435f-8869-6f17cb1ed23e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:52.829071 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3f3655e-5026-435f-8869-6f17cb1ed23e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:52.829872 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3f3655e-5026-435f-8869-6f17cb1ed23e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:52.830306 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3f3655e-5026-435f-8869-6f17cb1ed23e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:52.908199 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b3f3655e-5026-435f-8869-6f17cb1ed23e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.091630 Aug 13 04:30:52.909009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 117/220] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:52 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:53.017966 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1a188bdc-093a-47a9-bbf0-46d803a58555 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:53.018956 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1a188bdc-093a-47a9-bbf0-46d803a58555 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:53.026208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1a188bdc-093a-47a9-bbf0-46d803a58555 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:53.026630 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1a188bdc-093a-47a9-bbf0-46d803a58555 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:53.027488 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1a188bdc-093a-47a9-bbf0-46d803a58555 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:53.027922 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1a188bdc-093a-47a9-bbf0-46d803a58555 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:53.105354 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1a188bdc-093a-47a9-bbf0-46d803a58555 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14 microversion: 2.1 time: 0.091362 Aug 13 04:30:53.106262 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 104/221] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:30:53 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:30:53.923850 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-617153cf-f4a2-4b15-b0b5-c55b61deab08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:53.924989 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-617153cf-f4a2-4b15-b0b5-c55b61deab08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:53.935829 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-617153cf-f4a2-4b15-b0b5-c55b61deab08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:53.936325 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-617153cf-f4a2-4b15-b0b5-c55b61deab08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:53.937050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-617153cf-f4a2-4b15-b0b5-c55b61deab08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:53.937512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-617153cf-f4a2-4b15-b0b5-c55b61deab08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:54.005252 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-617153cf-f4a2-4b15-b0b5-c55b61deab08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.085268 Aug 13 04:30:54.006013 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 118/222] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:53 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:54.116616 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-785f6cf1-97cd-4f24-b05f-38f81b920a07 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:54.117773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-785f6cf1-97cd-4f24-b05f-38f81b920a07 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:54.124633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-785f6cf1-97cd-4f24-b05f-38f81b920a07 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:54.125065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-785f6cf1-97cd-4f24-b05f-38f81b920a07 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:54.125876 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-785f6cf1-97cd-4f24-b05f-38f81b920a07 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:54.126544 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-785f6cf1-97cd-4f24-b05f-38f81b920a07 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:54.199725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-785f6cf1-97cd-4f24-b05f-38f81b920a07 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14 microversion: 2.1 time: 0.086878 Aug 13 04:30:54.200411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 105/223] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:30:54 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:30:55.022474 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0d6d183c-269e-4685-a179-ee2f8ed4f910 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:55.025299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0d6d183c-269e-4685-a179-ee2f8ed4f910 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:55.032215 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0d6d183c-269e-4685-a179-ee2f8ed4f910 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:55.032532 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0d6d183c-269e-4685-a179-ee2f8ed4f910 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:55.033367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0d6d183c-269e-4685-a179-ee2f8ed4f910 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:55.033956 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0d6d183c-269e-4685-a179-ee2f8ed4f910 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:55.109380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0d6d183c-269e-4685-a179-ee2f8ed4f910 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.095923 Aug 13 04:30:55.110234 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 119/224] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:55 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:55.211418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-919b0e14-8bff-4982-ae4a-68827b524489 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:55.212408 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-919b0e14-8bff-4982-ae4a-68827b524489 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:55.219381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-919b0e14-8bff-4982-ae4a-68827b524489 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:55.220008 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-919b0e14-8bff-4982-ae4a-68827b524489 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:55.221072 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-919b0e14-8bff-4982-ae4a-68827b524489 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:55.221391 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-919b0e14-8bff-4982-ae4a-68827b524489 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:55.313028 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-919b0e14-8bff-4982-ae4a-68827b524489 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14 microversion: 2.1 time: 0.106143 Aug 13 04:30:55.313964 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 106/225] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:30:55 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:30:56.122404 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-84b106b6-9ad2-44a5-94d9-608d08d4c401 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:56.123407 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-84b106b6-9ad2-44a5-94d9-608d08d4c401 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:56.130210 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-84b106b6-9ad2-44a5-94d9-608d08d4c401 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:56.130696 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-84b106b6-9ad2-44a5-94d9-608d08d4c401 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:56.131358 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-84b106b6-9ad2-44a5-94d9-608d08d4c401 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:56.131791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-84b106b6-9ad2-44a5-94d9-608d08d4c401 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:56.199554 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-84b106b6-9ad2-44a5-94d9-608d08d4c401 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.082086 Aug 13 04:30:56.200345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 120/226] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:56 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:56.325332 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0cbed378-6860-44e2-a3b9-20caf9abbe94 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:56.326345 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0cbed378-6860-44e2-a3b9-20caf9abbe94 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:56.332802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0cbed378-6860-44e2-a3b9-20caf9abbe94 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:56.333243 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0cbed378-6860-44e2-a3b9-20caf9abbe94 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:56.334075 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0cbed378-6860-44e2-a3b9-20caf9abbe94 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:56.334477 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0cbed378-6860-44e2-a3b9-20caf9abbe94 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:56.458472 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0cbed378-6860-44e2-a3b9-20caf9abbe94 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14 microversion: 2.1 time: 0.137007 Aug 13 04:30:56.459209 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 107/227] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:30:56 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:30:57.227875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9e7a53a9-19c4-4bef-835e-019b060aa04b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:57.230540 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9e7a53a9-19c4-4bef-835e-019b060aa04b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:57.239775 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e7a53a9-19c4-4bef-835e-019b060aa04b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:57.240872 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e7a53a9-19c4-4bef-835e-019b060aa04b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:57.242463 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e7a53a9-19c4-4bef-835e-019b060aa04b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:57.243248 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e7a53a9-19c4-4bef-835e-019b060aa04b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:57.355255 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9e7a53a9-19c4-4bef-835e-019b060aa04b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.145173 Aug 13 04:30:57.356199 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 121/228] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:57 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:57.473124 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-97cecbcf-a4b2-41a9-88f9-f90e335b380c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:57.474728 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-97cecbcf-a4b2-41a9-88f9-f90e335b380c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:57.482419 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97cecbcf-a4b2-41a9-88f9-f90e335b380c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:57.482857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97cecbcf-a4b2-41a9-88f9-f90e335b380c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:57.483631 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97cecbcf-a4b2-41a9-88f9-f90e335b380c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:57.484057 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97cecbcf-a4b2-41a9-88f9-f90e335b380c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:57.567914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-97cecbcf-a4b2-41a9-88f9-f90e335b380c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14 microversion: 2.1 time: 0.100705 Aug 13 04:30:57.569362 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 108/229] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:30:57 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:30:57.884114 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d102da2a-01c7-4af1-b6b0-846c3f2f1ff6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:57.891050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d102da2a-01c7-4af1-b6b0-846c3f2f1ff6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:57.898840 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d102da2a-01c7-4af1-b6b0-846c3f2f1ff6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:57.899537 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d102da2a-01c7-4af1-b6b0-846c3f2f1ff6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:57.908133 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d102da2a-01c7-4af1-b6b0-846c3f2f1ff6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:57.908565 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d102da2a-01c7-4af1-b6b0-846c3f2f1ff6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:57.935452 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d102da2a-01c7-4af1-b6b0-846c3f2f1ff6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:30:58.039778 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d102da2a-01c7-4af1-b6b0-846c3f2f1ff6 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 204 len: 0 microversion: 2.1 time: 0.159055 Aug 13 04:30:58.043644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 122/230] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:30:57 2021] DELETE /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:30:58.052168 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-6acf6a8e-73bd-4e7a-a262-a69d0c5a0096 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:58.052168 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6acf6a8e-73bd-4e7a-a262-a69d0c5a0096 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:58.058832 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6acf6a8e-73bd-4e7a-a262-a69d0c5a0096 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:58.059272 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6acf6a8e-73bd-4e7a-a262-a69d0c5a0096 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:58.060043 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6acf6a8e-73bd-4e7a-a262-a69d0c5a0096 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:58.060471 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6acf6a8e-73bd-4e7a-a262-a69d0c5a0096 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:58.196295 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-6acf6a8e-73bd-4e7a-a262-a69d0c5a0096 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:58.205167 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-6acf6a8e-73bd-4e7a-a262-a69d0c5a0096 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1553 microversion: 2.1 time: 0.159705 Aug 13 04:30:58.205803 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 109/231] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:58 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1553 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:58.367886 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b9b50dcc-deb7-4939-8205-d39f4fd0c80d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:58.369003 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b9b50dcc-deb7-4939-8205-d39f4fd0c80d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:58.375361 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9b50dcc-deb7-4939-8205-d39f4fd0c80d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:58.376368 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9b50dcc-deb7-4939-8205-d39f4fd0c80d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:58.376696 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9b50dcc-deb7-4939-8205-d39f4fd0c80d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:58.377129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9b50dcc-deb7-4939-8205-d39f4fd0c80d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:58.448997 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b9b50dcc-deb7-4939-8205-d39f4fd0c80d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.085569 Aug 13 04:30:58.449692 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 123/232] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:58 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:30:58.581505 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-120d6ed5-c29a-4016-95b6-aac816a5be66 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:58.583575 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-120d6ed5-c29a-4016-95b6-aac816a5be66 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:58.597725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-120d6ed5-c29a-4016-95b6-aac816a5be66 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:58.597725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-120d6ed5-c29a-4016-95b6-aac816a5be66 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:58.598178 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-120d6ed5-c29a-4016-95b6-aac816a5be66 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:58.599048 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-120d6ed5-c29a-4016-95b6-aac816a5be66 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:58.697304 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-120d6ed5-c29a-4016-95b6-aac816a5be66 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14 microversion: 2.1 time: 0.119267 Aug 13 04:30:58.698192 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 110/233] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:30:58 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:30:59.224774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-afe46390-d6fc-4ed7-a272-e85bdee94965 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:30:59.225619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-afe46390-d6fc-4ed7-a272-e85bdee94965 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:59.233220 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-afe46390-d6fc-4ed7-a272-e85bdee94965 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:59.233707 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-afe46390-d6fc-4ed7-a272-e85bdee94965 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:59.234586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-afe46390-d6fc-4ed7-a272-e85bdee94965 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:59.235041 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-afe46390-d6fc-4ed7-a272-e85bdee94965 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:59.378654 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-afe46390-d6fc-4ed7-a272-e85bdee94965 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:30:59.387421 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-afe46390-d6fc-4ed7-a272-e85bdee94965 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1553 microversion: 2.1 time: 0.167021 Aug 13 04:30:59.388064 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 124/234] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:30:59 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1553 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:59.461383 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b7c52acf-0f20-4d08-8844-9018e9cae4cf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:59.462439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b7c52acf-0f20-4d08-8844-9018e9cae4cf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:59.470384 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b7c52acf-0f20-4d08-8844-9018e9cae4cf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:59.470911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b7c52acf-0f20-4d08-8844-9018e9cae4cf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:59.471764 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b7c52acf-0f20-4d08-8844-9018e9cae4cf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:59.472193 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b7c52acf-0f20-4d08-8844-9018e9cae4cf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:59.564299 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b7c52acf-0f20-4d08-8844-9018e9cae4cf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.107438 Aug 13 04:30:59.564940 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 111/235] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:30:59 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:30:59.708518 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-81472433-41e1-4f4e-888f-0cfd32aacd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:30:59.709399 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-81472433-41e1-4f4e-888f-0cfd32aacd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:30:59.716004 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-81472433-41e1-4f4e-888f-0cfd32aacd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:59.716458 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-81472433-41e1-4f4e-888f-0cfd32aacd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:59.717257 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-81472433-41e1-4f4e-888f-0cfd32aacd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:30:59.717724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-81472433-41e1-4f4e-888f-0cfd32aacd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:30:59.804016 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-81472433-41e1-4f4e-888f-0cfd32aacd7f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14 microversion: 2.1 time: 0.098589 Aug 13 04:30:59.807916 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 125/236] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:30:59 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:31:00.405220 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ed369b20-9719-4cca-8bf5-7dc9960d361a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:00.405952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ed369b20-9719-4cca-8bf5-7dc9960d361a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:00.412520 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ed369b20-9719-4cca-8bf5-7dc9960d361a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:00.412966 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ed369b20-9719-4cca-8bf5-7dc9960d361a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:00.413839 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ed369b20-9719-4cca-8bf5-7dc9960d361a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:00.415063 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ed369b20-9719-4cca-8bf5-7dc9960d361a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:00.560204 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ed369b20-9719-4cca-8bf5-7dc9960d361a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:00.574525 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ed369b20-9719-4cca-8bf5-7dc9960d361a tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1553 microversion: 2.1 time: 0.171949 Aug 13 04:31:00.575379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 112/237] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:00 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1553 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:00.577050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6152f968-a146-4e3e-95a6-1bec2f74863e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:00.578163 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6152f968-a146-4e3e-95a6-1bec2f74863e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:00.588405 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6152f968-a146-4e3e-95a6-1bec2f74863e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:00.588861 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6152f968-a146-4e3e-95a6-1bec2f74863e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:00.589682 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6152f968-a146-4e3e-95a6-1bec2f74863e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:00.590120 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6152f968-a146-4e3e-95a6-1bec2f74863e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:00.689900 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6152f968-a146-4e3e-95a6-1bec2f74863e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14 microversion: 2.20 time: 0.117053 Aug 13 04:31:00.693329 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 126/238] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:00 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:00.815683 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0bfa1343-21e0-4561-b761-2dfef6a7bb4b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:00.816719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0bfa1343-21e0-4561-b761-2dfef6a7bb4b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:00.823891 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0bfa1343-21e0-4561-b761-2dfef6a7bb4b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:00.824971 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0bfa1343-21e0-4561-b761-2dfef6a7bb4b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:00.825872 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0bfa1343-21e0-4561-b761-2dfef6a7bb4b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:00.826307 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0bfa1343-21e0-4561-b761-2dfef6a7bb4b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:00.914996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0bfa1343-21e0-4561-b761-2dfef6a7bb4b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14 microversion: 2.1 time: 0.101988 Aug 13 04:31:00.915673 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 113/239] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:00 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:31:01.437734 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-feb0ec9f-8c76-4ed4-9f1b-56543517c5b3 req-654d7a2d-8027-4cc8-ac73-2f5744c79ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "47f20e62-089b-4313-bad1-6139880e21cd", "name": "network-vif-deleted", "tag": "7ac239ef-8a51-4298-8f3f-3e873f6190de"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:01.439731 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:01.439731 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:31:01.449171 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-feb0ec9f-8c76-4ed4-9f1b-56543517c5b3 req-654d7a2d-8027-4cc8-ac73-2f5744c79ff7 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:01.449648 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-feb0ec9f-8c76-4ed4-9f1b-56543517c5b3 req-654d7a2d-8027-4cc8-ac73-2f5744c79ff7 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:01.461476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-feb0ec9f-8c76-4ed4-9f1b-56543517c5b3 req-654d7a2d-8027-4cc8-ac73-2f5744c79ff7 service nova] Creating event network-vif-deleted:7ac239ef-8a51-4298-8f3f-3e873f6190de for instance 47f20e62-089b-4313-bad1-6139880e21cd on hv-cinder-75996 Aug 13 04:31:01.466628 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-feb0ec9f-8c76-4ed4-9f1b-56543517c5b3 req-654d7a2d-8027-4cc8-ac73-2f5744c79ff7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032942 Aug 13 04:31:01.467227 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 127/240] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:01.594741 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c5a5f405-bc57-45f6-9ea9-354d691a29e7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:01.595489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c5a5f405-bc57-45f6-9ea9-354d691a29e7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:01.603976 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c5a5f405-bc57-45f6-9ea9-354d691a29e7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:01.604428 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c5a5f405-bc57-45f6-9ea9-354d691a29e7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:01.605205 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c5a5f405-bc57-45f6-9ea9-354d691a29e7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:01.605667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c5a5f405-bc57-45f6-9ea9-354d691a29e7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:01.701233 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2d8c9ce1-2b08-4b96-a28c-23b67f54a268 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:01.702409 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2d8c9ce1-2b08-4b96-a28c-23b67f54a268 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:01.707098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c5a5f405-bc57-45f6-9ea9-354d691a29e7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:01.716099 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2d8c9ce1-2b08-4b96-a28c-23b67f54a268 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:01.716737 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2d8c9ce1-2b08-4b96-a28c-23b67f54a268 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:01.717715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2d8c9ce1-2b08-4b96-a28c-23b67f54a268 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:01.718232 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2d8c9ce1-2b08-4b96-a28c-23b67f54a268 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:01.736780 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c5a5f405-bc57-45f6-9ea9-354d691a29e7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1345 microversion: 2.1 time: 0.146218 Aug 13 04:31:01.738227 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 114/241] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:01 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1345 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:01.826957 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2d8c9ce1-2b08-4b96-a28c-23b67f54a268 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 6451 microversion: 2.20 time: 0.129181 Aug 13 04:31:01.827757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 128/242] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:01 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 6451 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:31:01.902996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1298979745", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "networks": [{"uuid": "0ac580e7-d1b2-46c1-ae42-d5c12c542de0"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:01.928622 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b09db709-8245-4e61-8c20-475fcda222eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:01.930164 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b09db709-8245-4e61-8c20-475fcda222eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:01.937673 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b09db709-8245-4e61-8c20-475fcda222eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:01.938646 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b09db709-8245-4e61-8c20-475fcda222eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:01.939718 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b09db709-8245-4e61-8c20-475fcda222eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:01.940752 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b09db709-8245-4e61-8c20-475fcda222eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:01.985613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] validate_networks() for [('0ac580e7-d1b2-46c1-ae42-d5c12c542de0', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:31:02.044892 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b09db709-8245-4e61-8c20-475fcda222eb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 298 microversion: 2.1 time: 0.121448 Aug 13 04:31:02.048886 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 129/243] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:01 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 298 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:02.448331 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:31:02.448756 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:31:02.449367 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:31:02.449929 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:31:02.450369 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:31:02.463734 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:02.464279 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:02.465173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:02.465789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:02.494208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Getting quotas for project af89c6f3ec974defb8233cfefa31e914. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:31:02.498596 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Getting quotas for user 4921641e77d841e98ecc91f020df4251 and project af89c6f3ec974defb8233cfefa31e914. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:31:02.511605 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:31:02.514247 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:31:02.585359 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9531418c-0003-44c7-b720-0cfacdf9b080 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.689924 Aug 13 04:31:02.586570 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 115/244] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:31:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 692 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:31:02.598950 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f2451a03-2ed7-423e-a52e-80bff0210808 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:02.606880 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f2451a03-2ed7-423e-a52e-80bff0210808 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:02.696019 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f2451a03-2ed7-423e-a52e-80bff0210808 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:02.705574 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f2451a03-2ed7-423e-a52e-80bff0210808 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1214 microversion: 2.1 time: 0.112370 Aug 13 04:31:02.707562 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 130/245] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:02 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1214 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:02.766792 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:02.768268 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:02.798759 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:02.800081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.020s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:02.806210 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:02.807056 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:02.849149 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-80735671-e093-48be-9826-65b4e11781f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:02.858274 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-80735671-e093-48be-9826-65b4e11781f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:02.894540 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-80735671-e093-48be-9826-65b4e11781f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:02.897660 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-80735671-e093-48be-9826-65b4e11781f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:02.903403 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-80735671-e093-48be-9826-65b4e11781f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:02.904029 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-80735671-e093-48be-9826-65b4e11781f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:02.919920 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:02.920564 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:02.921126 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lazy-loading 'fault' on Instance uuid 47f20e62-089b-4313-bad1-6139880e21cd {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:31:02.983454 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a59eead9e8f141bf8a62ad838823e0a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '41073eeaf0b24fdda847a5a1ee0954c6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:02.993901 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5c3e2d89-56af-4a18-bea9-073337b2bbde tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 200 len: 1304 microversion: 2.1 time: 0.240528 Aug 13 04:31:02.995345 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 116/246] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:02 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 1304 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:03.016421 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-80735671-e093-48be-9826-65b4e11781f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 10658 microversion: 2.20 time: 0.180819 Aug 13 04:31:03.017527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 131/247] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:02 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 10658 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:03.059999 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2d3c7816-7fca-4e50-9575-f0848fd45641 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:03.061959 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2d3c7816-7fca-4e50-9575-f0848fd45641 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:03.075433 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d3c7816-7fca-4e50-9575-f0848fd45641 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:03.076565 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d3c7816-7fca-4e50-9575-f0848fd45641 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:03.081750 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d3c7816-7fca-4e50-9575-f0848fd45641 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:03.082678 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d3c7816-7fca-4e50-9575-f0848fd45641 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:03.181097 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2d3c7816-7fca-4e50-9575-f0848fd45641 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 6451 microversion: 2.1 time: 0.127481 Aug 13 04:31:03.181808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 117/248] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:03 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 6451 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:03.727717 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6a7a0a81-e2b1-42e0-b7b3-9f296977ee48 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:03.728526 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6a7a0a81-e2b1-42e0-b7b3-9f296977ee48 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:03.736554 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a7a0a81-e2b1-42e0-b7b3-9f296977ee48 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:03.737579 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a7a0a81-e2b1-42e0-b7b3-9f296977ee48 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:03.738624 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a7a0a81-e2b1-42e0-b7b3-9f296977ee48 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:03.739178 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a7a0a81-e2b1-42e0-b7b3-9f296977ee48 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:03.844669 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6a7a0a81-e2b1-42e0-b7b3-9f296977ee48 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:03.857795 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6a7a0a81-e2b1-42e0-b7b3-9f296977ee48 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1266 microversion: 2.1 time: 0.136689 Aug 13 04:31:03.858816 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 132/249] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:03 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1266 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:04.014676 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-55dd31dc-d344-4ca5-8b25-bfc79c3c77b2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:04.015540 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-55dd31dc-d344-4ca5-8b25-bfc79c3c77b2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:04.031921 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b03f129f-03a4-4463-bb34-85b6fc869c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:04.037060 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b03f129f-03a4-4463-bb34-85b6fc869c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:04.042851 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-55dd31dc-d344-4ca5-8b25-bfc79c3c77b2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:04.043618 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-55dd31dc-d344-4ca5-8b25-bfc79c3c77b2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:04.044873 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-55dd31dc-d344-4ca5-8b25-bfc79c3c77b2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:04.045323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-55dd31dc-d344-4ca5-8b25-bfc79c3c77b2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:04.050366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b03f129f-03a4-4463-bb34-85b6fc869c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:04.051390 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b03f129f-03a4-4463-bb34-85b6fc869c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:04.052341 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b03f129f-03a4-4463-bb34-85b6fc869c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:04.052852 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b03f129f-03a4-4463-bb34-85b6fc869c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:04.113108 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-55dd31dc-d344-4ca5-8b25-bfc79c3c77b2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] HTTP exception thrown: Instance 47f20e62-089b-4313-bad1-6139880e21cd could not be found. Aug 13 04:31:04.115098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-55dd31dc-d344-4ca5-8b25-bfc79c3c77b2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Returning 404 to user: Instance 47f20e62-089b-4313-bad1-6139880e21cd could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:31:04.116132 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-55dd31dc-d344-4ca5-8b25-bfc79c3c77b2 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 404 len: 111 microversion: 2.1 time: 0.106946 Aug 13 04:31:04.122381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 118/250] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:04 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 111 bytes in 114 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:31:04.153915 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b03f129f-03a4-4463-bb34-85b6fc869c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 14114 microversion: 2.20 time: 0.124444 Aug 13 04:31:04.154590 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 133/251] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:04 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 14114 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:31:04.192806 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e5eeb3da-c622-4375-bbba-3fa9e71aa9b8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:04.194324 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e5eeb3da-c622-4375-bbba-3fa9e71aa9b8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:04.207706 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5eeb3da-c622-4375-bbba-3fa9e71aa9b8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:04.209286 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5eeb3da-c622-4375-bbba-3fa9e71aa9b8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:04.211778 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5eeb3da-c622-4375-bbba-3fa9e71aa9b8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:04.215453 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5eeb3da-c622-4375-bbba-3fa9e71aa9b8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:04.271176 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1946595303", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "networks": [{"uuid": "e5a4407b-136d-4505-b628-117c1b1fc3a4"}]}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:04.371878 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e5eeb3da-c622-4375-bbba-3fa9e71aa9b8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 10159 microversion: 2.1 time: 0.182589 Aug 13 04:31:04.372782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 119/252] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:04 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 10159 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:04.385349 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d1103f2f-09b4-428e-8ba8-50fbb80cc566 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:04.386801 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d1103f2f-09b4-428e-8ba8-50fbb80cc566 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:04.395396 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1103f2f-09b4-428e-8ba8-50fbb80cc566 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:04.396179 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1103f2f-09b4-428e-8ba8-50fbb80cc566 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:04.397224 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1103f2f-09b4-428e-8ba8-50fbb80cc566 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:04.397841 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1103f2f-09b4-428e-8ba8-50fbb80cc566 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:04.414822 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-d1103f2f-09b4-428e-8ba8-50fbb80cc566 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] HTTP exception thrown: Instance 47f20e62-089b-4313-bad1-6139880e21cd could not be found. Aug 13 04:31:04.415416 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d1103f2f-09b4-428e-8ba8-50fbb80cc566 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Returning 404 to user: Instance 47f20e62-089b-4313-bad1-6139880e21cd could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:31:04.416264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d1103f2f-09b4-428e-8ba8-50fbb80cc566 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.039110 Aug 13 04:31:04.417612 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 120/253] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:31:04 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:31:04.886923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c80cda11-777d-4cc7-80f4-b29e407baed5 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:04.887652 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c80cda11-777d-4cc7-80f4-b29e407baed5 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:04.894451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c80cda11-777d-4cc7-80f4-b29e407baed5 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:04.895268 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c80cda11-777d-4cc7-80f4-b29e407baed5 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:04.896189 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c80cda11-777d-4cc7-80f4-b29e407baed5 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:04.896783 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c80cda11-777d-4cc7-80f4-b29e407baed5 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:05.096081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c80cda11-777d-4cc7-80f4-b29e407baed5 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:05.106363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c80cda11-777d-4cc7-80f4-b29e407baed5 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.225022 Aug 13 04:31:05.107260 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 121/254] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:04 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:05.166329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c8636171-5644-45ed-9821-30a5813d49f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:05.167875 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c8636171-5644-45ed-9821-30a5813d49f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:05.174504 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c8636171-5644-45ed-9821-30a5813d49f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:05.174951 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c8636171-5644-45ed-9821-30a5813d49f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:05.175978 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c8636171-5644-45ed-9821-30a5813d49f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:05.176418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c8636171-5644-45ed-9821-30a5813d49f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:05.263799 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c8636171-5644-45ed-9821-30a5813d49f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 16035 microversion: 2.20 time: 0.101594 Aug 13 04:31:05.266626 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 122/255] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:05 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 16035 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:31:05.384643 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-37216cbc-2e9c-4b44-ad45-855644ca34e4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:05.385712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-37216cbc-2e9c-4b44-ad45-855644ca34e4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:05.393847 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-37216cbc-2e9c-4b44-ad45-855644ca34e4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:05.394398 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-37216cbc-2e9c-4b44-ad45-855644ca34e4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:05.395251 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-37216cbc-2e9c-4b44-ad45-855644ca34e4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:05.395661 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-37216cbc-2e9c-4b44-ad45-855644ca34e4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:05.486428 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-37216cbc-2e9c-4b44-ad45-855644ca34e4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 14352 microversion: 2.1 time: 0.105850 Aug 13 04:31:05.489998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 123/256] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:05 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 14352 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:31:05.677648 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e7a471c0-9b7e-4f54-97e3-a3d6d32bf0d7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:05.679040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e7a471c0-9b7e-4f54-97e3-a3d6d32bf0d7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:05.703797 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e7a471c0-9b7e-4f54-97e3-a3d6d32bf0d7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:05.704717 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e7a471c0-9b7e-4f54-97e3-a3d6d32bf0d7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:05.706318 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e7a471c0-9b7e-4f54-97e3-a3d6d32bf0d7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:05.707975 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e7a471c0-9b7e-4f54-97e3-a3d6d32bf0d7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:05.739752 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-e7a471c0-9b7e-4f54-97e3-a3d6d32bf0d7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] HTTP exception thrown: Instance 47f20e62-089b-4313-bad1-6139880e21cd could not be found. Aug 13 04:31:05.740961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e7a471c0-9b7e-4f54-97e3-a3d6d32bf0d7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Returning 404 to user: Instance 47f20e62-089b-4313-bad1-6139880e21cd could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:31:05.742943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e7a471c0-9b7e-4f54-97e3-a3d6d32bf0d7 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "DELETE /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 404 len: 111 microversion: 2.1 time: 0.073847 Aug 13 04:31:05.744077 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 124/257] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:31:05 2021] DELETE /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 13 04:31:05.755883 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0ee55243-26f6-4d23-8c79-6b340d108554 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:05.757921 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0ee55243-26f6-4d23-8c79-6b340d108554 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] [instance: 47f20e62-089b-4313-bad1-6139880e21cd] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:05.768476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0ee55243-26f6-4d23-8c79-6b340d108554 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:05.771607 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0ee55243-26f6-4d23-8c79-6b340d108554 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:05.772566 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0ee55243-26f6-4d23-8c79-6b340d108554 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:05.773606 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0ee55243-26f6-4d23-8c79-6b340d108554 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:05.793993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-0ee55243-26f6-4d23-8c79-6b340d108554 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] HTTP exception thrown: Instance 47f20e62-089b-4313-bad1-6139880e21cd could not be found. Aug 13 04:31:05.794859 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0ee55243-26f6-4d23-8c79-6b340d108554 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] Returning 404 to user: Instance 47f20e62-089b-4313-bad1-6139880e21cd could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:31:05.796284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0ee55243-26f6-4d23-8c79-6b340d108554 tempest-DeleteServersTestJSON-1456319707 tempest-DeleteServersTestJSON-1456319707-project] 10.222.0.13 "GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd" status: 404 len: 111 microversion: 2.1 time: 0.047583 Aug 13 04:31:05.796853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 125/258] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:05 2021] GET /compute/v2.1/servers/47f20e62-089b-4313-bad1-6139880e21cd => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:31:05.902568 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-973713eb-ceeb-408d-b5ec-b5d4c0bba575 req-8b719296-36ea-450a-8235-3b801465eb33 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01df6473-8705-4b35-95b2-844f9267f92e", "tag": "a9b019c3-b958-4aa5-8146-7bf11ad373de"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:05.906559 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:05.906559 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:31:05.919677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-973713eb-ceeb-408d-b5ec-b5d4c0bba575 req-8b719296-36ea-450a-8235-3b801465eb33 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:05.921962 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-973713eb-ceeb-408d-b5ec-b5d4c0bba575 req-8b719296-36ea-450a-8235-3b801465eb33 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:05.936457 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-973713eb-ceeb-408d-b5ec-b5d4c0bba575 req-8b719296-36ea-450a-8235-3b801465eb33 service nova] Creating event network-changed:a9b019c3-b958-4aa5-8146-7bf11ad373de for instance 01df6473-8705-4b35-95b2-844f9267f92e on hv-cinder-75996 Aug 13 04:31:05.943879 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-973713eb-ceeb-408d-b5ec-b5d4c0bba575 req-8b719296-36ea-450a-8235-3b801465eb33 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045927 Aug 13 04:31:05.946741 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 126/259] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:06.128007 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-93bf6c1e-4a7a-4c59-8ebe-c6993c730e82 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:06.129608 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-93bf6c1e-4a7a-4c59-8ebe-c6993c730e82 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:06.149345 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-93bf6c1e-4a7a-4c59-8ebe-c6993c730e82 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:06.150121 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-93bf6c1e-4a7a-4c59-8ebe-c6993c730e82 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:06.151418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-93bf6c1e-4a7a-4c59-8ebe-c6993c730e82 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:06.152250 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-93bf6c1e-4a7a-4c59-8ebe-c6993c730e82 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:06.757066 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-93bf6c1e-4a7a-4c59-8ebe-c6993c730e82 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:06.767363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-93bf6c1e-4a7a-4c59-8ebe-c6993c730e82 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.646359 Aug 13 04:31:06.768523 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 127/260] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:06 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:06.774375 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5c4e866f-b2b0-44d1-badd-19aebd54f2a7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:06.775562 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5c4e866f-b2b0-44d1-badd-19aebd54f2a7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:06.782305 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c4e866f-b2b0-44d1-badd-19aebd54f2a7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:06.783024 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c4e866f-b2b0-44d1-badd-19aebd54f2a7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:06.784085 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c4e866f-b2b0-44d1-badd-19aebd54f2a7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:06.784691 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c4e866f-b2b0-44d1-badd-19aebd54f2a7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:06.914022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5c4e866f-b2b0-44d1-badd-19aebd54f2a7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 17686 microversion: 2.20 time: 0.143288 Aug 13 04:31:06.915368 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 128/261] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:06 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 17686 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:06.929949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f8399bed-fbaa-4350-aaa1-66bbfb654598 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:06.935412 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f8399bed-fbaa-4350-aaa1-66bbfb654598 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:06.954508 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f8399bed-fbaa-4350-aaa1-66bbfb654598 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:06.955307 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f8399bed-fbaa-4350-aaa1-66bbfb654598 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:06.956533 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f8399bed-fbaa-4350-aaa1-66bbfb654598 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:06.957746 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f8399bed-fbaa-4350-aaa1-66bbfb654598 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:07.053291 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f8399bed-fbaa-4350-aaa1-66bbfb654598 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 17498 microversion: 2.1 time: 0.136245 Aug 13 04:31:07.054056 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 129/262] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:06 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 17498 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:07.795154 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-051a2678-6d3f-441a-821b-c6f6108f66b0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:07.796423 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-051a2678-6d3f-441a-821b-c6f6108f66b0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:07.832608 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-051a2678-6d3f-441a-821b-c6f6108f66b0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:07.833519 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-051a2678-6d3f-441a-821b-c6f6108f66b0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:07.834752 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-051a2678-6d3f-441a-821b-c6f6108f66b0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:07.836411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-051a2678-6d3f-441a-821b-c6f6108f66b0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:08.049372 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-051a2678-6d3f-441a-821b-c6f6108f66b0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:08.058344 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-051a2678-6d3f-441a-821b-c6f6108f66b0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.276146 Aug 13 04:31:08.068347 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 130/263] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:07 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:08.080733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ff877ef4-4f1a-4268-af38-a28c96927d99 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:08.081974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ff877ef4-4f1a-4268-af38-a28c96927d99 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:08.093460 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ff877ef4-4f1a-4268-af38-a28c96927d99 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:08.094562 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ff877ef4-4f1a-4268-af38-a28c96927d99 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:08.097937 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ff877ef4-4f1a-4268-af38-a28c96927d99 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:08.097937 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ff877ef4-4f1a-4268-af38-a28c96927d99 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:08.180700 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ff877ef4-4f1a-4268-af38-a28c96927d99 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 19342 microversion: 2.20 time: 0.108605 Aug 13 04:31:08.183045 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 131/264] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:08 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 19342 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:08.189133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-34a1b62e-aff0-4ef4-bc3d-5ca611e89d23 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:08.190399 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-34a1b62e-aff0-4ef4-bc3d-5ca611e89d23 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:08.199021 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34a1b62e-aff0-4ef4-bc3d-5ca611e89d23 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:08.199588 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34a1b62e-aff0-4ef4-bc3d-5ca611e89d23 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:08.200302 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34a1b62e-aff0-4ef4-bc3d-5ca611e89d23 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:08.200866 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34a1b62e-aff0-4ef4-bc3d-5ca611e89d23 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:08.281695 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-34a1b62e-aff0-4ef4-bc3d-5ca611e89d23 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 17602 microversion: 2.1 time: 0.096349 Aug 13 04:31:08.283058 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 132/265] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:08 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 17602 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:09.082007 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-6b040616-0567-4aac-b2f2-b2d4369164c0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:09.083443 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6b040616-0567-4aac-b2f2-b2d4369164c0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:09.093869 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b040616-0567-4aac-b2f2-b2d4369164c0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:09.094542 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b040616-0567-4aac-b2f2-b2d4369164c0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:09.095466 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b040616-0567-4aac-b2f2-b2d4369164c0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:09.096041 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b040616-0567-4aac-b2f2-b2d4369164c0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:09.443200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-6b040616-0567-4aac-b2f2-b2d4369164c0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:09.452076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-6b040616-0567-4aac-b2f2-b2d4369164c0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.376063 Aug 13 04:31:09.452854 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 133/266] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:09 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:09.457489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f17a52c1-fb08-40bc-9bea-0aa09904a7be tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:09.458894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f17a52c1-fb08-40bc-9bea-0aa09904a7be tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:09.465215 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f17a52c1-fb08-40bc-9bea-0aa09904a7be tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:09.465679 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f17a52c1-fb08-40bc-9bea-0aa09904a7be tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:09.466356 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f17a52c1-fb08-40bc-9bea-0aa09904a7be tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:09.466782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f17a52c1-fb08-40bc-9bea-0aa09904a7be tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:09.534497 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f17a52c1-fb08-40bc-9bea-0aa09904a7be tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 20985 microversion: 2.20 time: 0.080536 Aug 13 04:31:09.535439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 134/267] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:09 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 20985 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:09.541843 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a9a00ca1-aafa-4b55-b069-8ec89f9bc347 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:09.543226 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a9a00ca1-aafa-4b55-b069-8ec89f9bc347 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:09.551762 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a9a00ca1-aafa-4b55-b069-8ec89f9bc347 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:09.551762 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a9a00ca1-aafa-4b55-b069-8ec89f9bc347 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:09.552018 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a9a00ca1-aafa-4b55-b069-8ec89f9bc347 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:09.552302 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a9a00ca1-aafa-4b55-b069-8ec89f9bc347 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:09.659946 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a9a00ca1-aafa-4b55-b069-8ec89f9bc347 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 19342 microversion: 2.1 time: 0.122957 Aug 13 04:31:09.660799 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 135/268] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:09 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 19342 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:10.470242 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-518ba156-f883-4e2f-879a-4c904d000d41 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:10.470961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-518ba156-f883-4e2f-879a-4c904d000d41 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:10.483602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-518ba156-f883-4e2f-879a-4c904d000d41 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:10.484143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-518ba156-f883-4e2f-879a-4c904d000d41 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:10.485710 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-518ba156-f883-4e2f-879a-4c904d000d41 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:10.492491 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-518ba156-f883-4e2f-879a-4c904d000d41 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:10.653549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-518ba156-f883-4e2f-879a-4c904d000d41 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:10.672834 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-518ba156-f883-4e2f-879a-4c904d000d41 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.206455 Aug 13 04:31:10.682682 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 136/269] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:10 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:10.682682 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9c5c25b1-c41e-40a7-a560-f6c987a00d5c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:10.683148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9c5c25b1-c41e-40a7-a560-f6c987a00d5c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:10.699611 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c5c25b1-c41e-40a7-a560-f6c987a00d5c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:10.699822 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c5c25b1-c41e-40a7-a560-f6c987a00d5c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:10.700525 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c5c25b1-c41e-40a7-a560-f6c987a00d5c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:10.700956 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c5c25b1-c41e-40a7-a560-f6c987a00d5c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:10.790730 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9c5c25b1-c41e-40a7-a560-f6c987a00d5c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 22653 microversion: 2.20 time: 0.115625 Aug 13 04:31:10.793102 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 137/270] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:10 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 22653 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:10.802234 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8127779b-68f8-4c9e-9706-432459824440 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:10.803362 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8127779b-68f8-4c9e-9706-432459824440 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:10.812055 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8127779b-68f8-4c9e-9706-432459824440 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:10.812505 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8127779b-68f8-4c9e-9706-432459824440 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:10.813301 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8127779b-68f8-4c9e-9706-432459824440 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:10.813907 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8127779b-68f8-4c9e-9706-432459824440 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:10.898498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8127779b-68f8-4c9e-9706-432459824440 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 21733 microversion: 2.1 time: 0.103353 Aug 13 04:31:10.899352 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 138/271] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:10 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 21733 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:11.690984 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2c74a59b-6459-4c7e-bf93-ead66f75bcfd tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:11.692589 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2c74a59b-6459-4c7e-bf93-ead66f75bcfd tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:11.701167 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c74a59b-6459-4c7e-bf93-ead66f75bcfd tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:11.711454 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c74a59b-6459-4c7e-bf93-ead66f75bcfd tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:11.712629 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c74a59b-6459-4c7e-bf93-ead66f75bcfd tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:11.713221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c74a59b-6459-4c7e-bf93-ead66f75bcfd tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:11.958721 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2c74a59b-6459-4c7e-bf93-ead66f75bcfd tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:11.969609 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2c74a59b-6459-4c7e-bf93-ead66f75bcfd tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.282670 Aug 13 04:31:11.974064 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 139/272] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:11 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:11.998999 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1711aa8a-fab2-4f3c-8a2e-f0ce140b8899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:12.000554 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1711aa8a-fab2-4f3c-8a2e-f0ce140b8899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:12.016058 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1711aa8a-fab2-4f3c-8a2e-f0ce140b8899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:12.017886 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1711aa8a-fab2-4f3c-8a2e-f0ce140b8899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:12.020525 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1711aa8a-fab2-4f3c-8a2e-f0ce140b8899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:12.021236 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1711aa8a-fab2-4f3c-8a2e-f0ce140b8899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:12.110211 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1711aa8a-fab2-4f3c-8a2e-f0ce140b8899 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 23791 microversion: 2.20 time: 0.134799 Aug 13 04:31:12.110857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 140/273] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:11 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 23791 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:12.117369 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b59c9a26-42ea-4b21-9a9c-b95c7f6929d6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:12.118552 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b59c9a26-42ea-4b21-9a9c-b95c7f6929d6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:12.137464 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b59c9a26-42ea-4b21-9a9c-b95c7f6929d6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:12.137464 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b59c9a26-42ea-4b21-9a9c-b95c7f6929d6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:12.137464 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b59c9a26-42ea-4b21-9a9c-b95c7f6929d6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:12.137464 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b59c9a26-42ea-4b21-9a9c-b95c7f6929d6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:12.226035 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b59c9a26-42ea-4b21-9a9c-b95c7f6929d6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 23178 microversion: 2.1 time: 0.113522 Aug 13 04:31:12.227086 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 141/274] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:12 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 23178 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:12.990211 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ec359889-dcc6-4079-82f4-8a7d6b05cd0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:12.991679 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ec359889-dcc6-4079-82f4-8a7d6b05cd0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:12.999335 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ec359889-dcc6-4079-82f4-8a7d6b05cd0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:13.000138 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ec359889-dcc6-4079-82f4-8a7d6b05cd0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:13.001174 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ec359889-dcc6-4079-82f4-8a7d6b05cd0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:13.001878 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ec359889-dcc6-4079-82f4-8a7d6b05cd0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:13.191319 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ec359889-dcc6-4079-82f4-8a7d6b05cd0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:13.202619 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ec359889-dcc6-4079-82f4-8a7d6b05cd0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.216539 Aug 13 04:31:13.213306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 142/275] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:12 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:13.217893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c0298573-34da-4b25-aa92-d82690e0ffc6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:13.218793 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c0298573-34da-4b25-aa92-d82690e0ffc6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:13.228677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c0298573-34da-4b25-aa92-d82690e0ffc6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:13.229239 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c0298573-34da-4b25-aa92-d82690e0ffc6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:13.230269 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c0298573-34da-4b25-aa92-d82690e0ffc6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:13.230920 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c0298573-34da-4b25-aa92-d82690e0ffc6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:13.307230 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c0298573-34da-4b25-aa92-d82690e0ffc6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 24677 microversion: 2.20 time: 0.093054 Aug 13 04:31:13.308507 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 143/276] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:13 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 24677 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:13.313913 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b6d6c2ce-8712-47b6-b3e9-81f5993d8ef1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:13.315075 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b6d6c2ce-8712-47b6-b3e9-81f5993d8ef1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:13.322629 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b6d6c2ce-8712-47b6-b3e9-81f5993d8ef1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:13.323273 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b6d6c2ce-8712-47b6-b3e9-81f5993d8ef1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:13.324188 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b6d6c2ce-8712-47b6-b3e9-81f5993d8ef1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:13.338403 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b6d6c2ce-8712-47b6-b3e9-81f5993d8ef1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:13.411424 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b6d6c2ce-8712-47b6-b3e9-81f5993d8ef1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 24380 microversion: 2.1 time: 0.100795 Aug 13 04:31:13.411714 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 144/277] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:13 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 24380 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:13.526853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1007989077", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8654c056-764c-4f00-9b64-d8b811de2fd6"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:16.406741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.network.neutron [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] validate_networks() for [('e5a4407b-136d-4505-b628-117c1b1fc3a4', None, None, None)] {{(pid=108287) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:31:16.422567 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] validate_networks() for [('8654c056-764c-4f00-9b64-d8b811de2fd6', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:31:17.247525 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Flavor limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:31:17.248097 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Image limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:31:17.248697 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Flavor pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:31:17.249177 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Image pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:31:17.249713 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:31:17.250968 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:31:17.251385 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:31:17.251853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:31:17.252251 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:31:17.252668 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:31:17.259361 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:17.259808 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:17.260778 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:17.261287 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:17.262048 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:17.262605 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:17.263471 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:17.264012 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:17.283527 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Getting quotas for project aae4e92976894be69e6eb06d4b7d2f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:31:17.287519 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Getting quotas for user 4b4e286001664c959d7a80966e8c1294 and project aae4e92976894be69e6eb06d4b7d2f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:31:17.291441 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Getting quotas for project 44afcd45727640ec80dc17fe4fcf67fb. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:31:17.295497 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Getting quotas for user 1c6fcd7ffd124e7aa7ace34bed7f7423 and project 44afcd45727640ec80dc17fe4fcf67fb. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:31:17.298685 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:31:17.301058 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:31:17.307114 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Going to run 1 instances... {{(pid=108287) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:31:17.309608 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:31:17.347379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2ae02d99-6895-4804-8d34-1db7d0619a53 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.934268 Aug 13 04:31:17.353109 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 145/278] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:31:13 2021] POST /compute/v2.1/servers => generated 383 bytes in 3936 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:31:17.357022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-73eecfc2-e959-400a-8b5b-eda9c10dd171 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:17.357856 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-73eecfc2-e959-400a-8b5b-eda9c10dd171 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:17.364074 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-73eecfc2-e959-400a-8b5b-eda9c10dd171 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:17.364530 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-73eecfc2-e959-400a-8b5b-eda9c10dd171 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:17.365028 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9c57a97c-4b44-4122-84dd-e674a80a51c3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 13.101928 Aug 13 04:31:17.365303 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-73eecfc2-e959-400a-8b5b-eda9c10dd171 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:17.365780 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-73eecfc2-e959-400a-8b5b-eda9c10dd171 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:17.370900 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 134/279] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:31:04 2021] POST /compute/v2.1/servers => generated 380 bytes in 13109 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 13 04:31:17.389267 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7fdd8a67-3cc7-4a09-84b8-892bd9099ad8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:17.390558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7fdd8a67-3cc7-4a09-84b8-892bd9099ad8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:17.400737 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7fdd8a67-3cc7-4a09-84b8-892bd9099ad8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:17.401276 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7fdd8a67-3cc7-4a09-84b8-892bd9099ad8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:17.402150 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7fdd8a67-3cc7-4a09-84b8-892bd9099ad8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:17.402683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7fdd8a67-3cc7-4a09-84b8-892bd9099ad8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:17.503478 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7fdd8a67-3cc7-4a09-84b8-892bd9099ad8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 27441 microversion: 2.20 time: 0.131200 Aug 13 04:31:17.505664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 135/280] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:17 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 27441 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:17.511461 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-064e5549-149f-48dc-828c-9040481463c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:17.512604 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-064e5549-149f-48dc-828c-9040481463c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:17.520734 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-064e5549-149f-48dc-828c-9040481463c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:17.521175 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-064e5549-149f-48dc-828c-9040481463c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:17.522474 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-064e5549-149f-48dc-828c-9040481463c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:17.523794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-064e5549-149f-48dc-828c-9040481463c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:17.560122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-73eecfc2-e959-400a-8b5b-eda9c10dd171 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:17.568880 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-73eecfc2-e959-400a-8b5b-eda9c10dd171 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.219574 Aug 13 04:31:17.572928 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 146/281] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:17 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:17.586722 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1ecc5093-251e-4850-a414-d67fe216582e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:17.587351 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1ecc5093-251e-4850-a414-d67fe216582e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:17.614437 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-064e5549-149f-48dc-828c-9040481463c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 27213 microversion: 2.1 time: 0.107214 Aug 13 04:31:17.614998 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 136/282] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:17 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 27213 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:17.628930 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e36308a7-de50-4834-b0ec-0300ff5846c7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:17.629663 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e36308a7-de50-4834-b0ec-0300ff5846c7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:17.664294 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1ecc5093-251e-4850-a414-d67fe216582e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:17.673381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1ecc5093-251e-4850-a414-d67fe216582e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1222 microversion: 2.1 time: 0.097963 Aug 13 04:31:17.673849 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 147/283] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:17 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1222 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:17.724422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e36308a7-de50-4834-b0ec-0300ff5846c7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:17.733746 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e36308a7-de50-4834-b0ec-0300ff5846c7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1218 microversion: 2.1 time: 0.117316 Aug 13 04:31:17.742854 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 137/284] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:17 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1218 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:17.752656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-760559158", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8654c056-764c-4f00-9b64-d8b811de2fd6"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:17.809306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] validate_networks() for [('8654c056-764c-4f00-9b64-d8b811de2fd6', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:31:18.237744 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:31:18.238170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:31:18.239002 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:31:18.239763 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:31:18.240185 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:31:18.249247 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:18.249724 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:18.250530 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:18.250958 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:18.266800 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Getting quotas for project aae4e92976894be69e6eb06d4b7d2f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:31:18.270413 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Getting quotas for user 4b4e286001664c959d7a80966e8c1294 and project aae4e92976894be69e6eb06d4b7d2f3a. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:31:18.281203 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:31:18.283380 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:31:18.326775 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-6b3a1287-e5db-4bf8-a164-a6ace59c74bf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.578056 Aug 13 04:31:18.327400 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 148/285] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:31:17 2021] POST /compute/v2.1/servers => generated 383 bytes in 579 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:31:18.337581 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d606409a-8d8e-49e4-846f-54bbfdb3d510 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:18.338286 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d606409a-8d8e-49e4-846f-54bbfdb3d510 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:18.396155 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d606409a-8d8e-49e4-846f-54bbfdb3d510 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:18.404630 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d606409a-8d8e-49e4-846f-54bbfdb3d510 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1221 microversion: 2.1 time: 0.071187 Aug 13 04:31:18.405313 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 138/286] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:18 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1221 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:18.516313 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-84a7235f-883c-482d-9390-8652b2f5d2d0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:18.517719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-84a7235f-883c-482d-9390-8652b2f5d2d0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:18.525851 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-84a7235f-883c-482d-9390-8652b2f5d2d0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:18.526302 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-84a7235f-883c-482d-9390-8652b2f5d2d0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:18.527112 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-84a7235f-883c-482d-9390-8652b2f5d2d0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:18.527547 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-84a7235f-883c-482d-9390-8652b2f5d2d0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:18.590777 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b4cd0081-aff0-4f7a-a366-b4b64e6a5595 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:18.591380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b4cd0081-aff0-4f7a-a366-b4b64e6a5595 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:18.598705 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b4cd0081-aff0-4f7a-a366-b4b64e6a5595 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:18.599482 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b4cd0081-aff0-4f7a-a366-b4b64e6a5595 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:18.600659 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b4cd0081-aff0-4f7a-a366-b4b64e6a5595 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:18.602010 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b4cd0081-aff0-4f7a-a366-b4b64e6a5595 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:18.608557 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-84a7235f-883c-482d-9390-8652b2f5d2d0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 27607 microversion: 2.20 time: 0.094438 Aug 13 04:31:18.612545 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 149/287] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:18 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 27607 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:18.637168 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-239ebcb9-b68b-40c3-98b5-d31dea363c53 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:18.644460 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-239ebcb9-b68b-40c3-98b5-d31dea363c53 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:18.653644 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-239ebcb9-b68b-40c3-98b5-d31dea363c53 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:18.654257 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-239ebcb9-b68b-40c3-98b5-d31dea363c53 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:18.655282 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-239ebcb9-b68b-40c3-98b5-d31dea363c53 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:18.655869 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-239ebcb9-b68b-40c3-98b5-d31dea363c53 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:18.778663 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-239ebcb9-b68b-40c3-98b5-d31dea363c53 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 27441 microversion: 2.1 time: 0.146865 Aug 13 04:31:18.779306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 150/288] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:18 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 27441 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:18.789108 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4c5f6d9b-473c-4aa2-b936-14f8de3a4495 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:18.790319 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4c5f6d9b-473c-4aa2-b936-14f8de3a4495 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:18.797014 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4c5f6d9b-473c-4aa2-b936-14f8de3a4495 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:18.797781 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4c5f6d9b-473c-4aa2-b936-14f8de3a4495 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:18.799081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4c5f6d9b-473c-4aa2-b936-14f8de3a4495 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:18.799888 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4c5f6d9b-473c-4aa2-b936-14f8de3a4495 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:18.899988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4c5f6d9b-473c-4aa2-b936-14f8de3a4495 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:18.907911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4c5f6d9b-473c-4aa2-b936-14f8de3a4495 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1270 microversion: 2.1 time: 0.127479 Aug 13 04:31:18.918096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 151/289] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:18 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1270 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:18.921579 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b4cd0081-aff0-4f7a-a366-b4b64e6a5595 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:18.928539 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b4cd0081-aff0-4f7a-a366-b4b64e6a5595 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.341611 Aug 13 04:31:18.938535 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 139/290] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:18 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:19.421590 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2574b9c4-72ce-445a-9b34-a4824826f666 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:19.422352 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2574b9c4-72ce-445a-9b34-a4824826f666 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:19.429207 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2574b9c4-72ce-445a-9b34-a4824826f666 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:19.430587 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2574b9c4-72ce-445a-9b34-a4824826f666 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:19.431470 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2574b9c4-72ce-445a-9b34-a4824826f666 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:19.432103 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2574b9c4-72ce-445a-9b34-a4824826f666 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:19.541844 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2574b9c4-72ce-445a-9b34-a4824826f666 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:19.549045 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2574b9c4-72ce-445a-9b34-a4824826f666 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1273 microversion: 2.1 time: 0.131350 Aug 13 04:31:19.549626 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 152/291] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:19 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1273 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:19.623373 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-cd8788ea-fe59-4b5f-a21d-0b06f882b51e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:19.624995 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-cd8788ea-fe59-4b5f-a21d-0b06f882b51e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:19.635843 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cd8788ea-fe59-4b5f-a21d-0b06f882b51e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:19.636388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cd8788ea-fe59-4b5f-a21d-0b06f882b51e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:19.637349 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cd8788ea-fe59-4b5f-a21d-0b06f882b51e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:19.637932 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cd8788ea-fe59-4b5f-a21d-0b06f882b51e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:19.732032 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-cd8788ea-fe59-4b5f-a21d-0b06f882b51e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 27717 microversion: 2.20 time: 0.113560 Aug 13 04:31:19.736031 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 140/292] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:19 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 27717 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:19.792452 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d6719a7b-3e05-4f2d-a2a4-c52d7c1b5fa9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:19.793348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d6719a7b-3e05-4f2d-a2a4-c52d7c1b5fa9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:19.799694 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6719a7b-3e05-4f2d-a2a4-c52d7c1b5fa9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:19.800162 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6719a7b-3e05-4f2d-a2a4-c52d7c1b5fa9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:19.800953 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6719a7b-3e05-4f2d-a2a4-c52d7c1b5fa9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:19.801373 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6719a7b-3e05-4f2d-a2a4-c52d7c1b5fa9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:19.880023 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d6719a7b-3e05-4f2d-a2a4-c52d7c1b5fa9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 27561 microversion: 2.1 time: 0.091192 Aug 13 04:31:19.884653 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 153/293] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:19 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 27561 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:19.928142 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-03bba4cc-d0c7-44f4-b034-b959882eb100 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:19.928774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-03bba4cc-d0c7-44f4-b034-b959882eb100 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:19.936083 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03bba4cc-d0c7-44f4-b034-b959882eb100 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:19.936526 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03bba4cc-d0c7-44f4-b034-b959882eb100 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:19.937311 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03bba4cc-d0c7-44f4-b034-b959882eb100 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:19.937800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03bba4cc-d0c7-44f4-b034-b959882eb100 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:19.950503 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-776c08a9-0dd1-4e3b-a6d7-a9cfbd3db23f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:19.952845 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-776c08a9-0dd1-4e3b-a6d7-a9cfbd3db23f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:19.962098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-776c08a9-0dd1-4e3b-a6d7-a9cfbd3db23f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:19.963811 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-776c08a9-0dd1-4e3b-a6d7-a9cfbd3db23f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:19.986770 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-776c08a9-0dd1-4e3b-a6d7-a9cfbd3db23f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:19.987389 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-776c08a9-0dd1-4e3b-a6d7-a9cfbd3db23f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.022s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:20.053723 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-03bba4cc-d0c7-44f4-b034-b959882eb100 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:20.084023 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-03bba4cc-d0c7-44f4-b034-b959882eb100 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1276 microversion: 2.1 time: 0.159386 Aug 13 04:31:20.102333 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 141/294] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:19 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1276 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:20.395655 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-776c08a9-0dd1-4e3b-a6d7-a9cfbd3db23f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:20.405699 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-776c08a9-0dd1-4e3b-a6d7-a9cfbd3db23f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.461972 Aug 13 04:31:20.406580 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 154/295] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:19 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:20.567121 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e05a7cea-5c27-4a9b-b894-64da2bb1a717 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:20.568306 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e05a7cea-5c27-4a9b-b894-64da2bb1a717 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:20.583625 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e05a7cea-5c27-4a9b-b894-64da2bb1a717 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:20.590260 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e05a7cea-5c27-4a9b-b894-64da2bb1a717 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:20.591256 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e05a7cea-5c27-4a9b-b894-64da2bb1a717 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:20.591859 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e05a7cea-5c27-4a9b-b894-64da2bb1a717 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:20.744430 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b2d91fec-15da-4e7b-90ae-7bd3d2b5b2ed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:20.745863 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b2d91fec-15da-4e7b-90ae-7bd3d2b5b2ed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:20.752984 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b2d91fec-15da-4e7b-90ae-7bd3d2b5b2ed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:20.753898 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b2d91fec-15da-4e7b-90ae-7bd3d2b5b2ed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:20.754953 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b2d91fec-15da-4e7b-90ae-7bd3d2b5b2ed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:20.755613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b2d91fec-15da-4e7b-90ae-7bd3d2b5b2ed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:20.981037 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e05a7cea-5c27-4a9b-b894-64da2bb1a717 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:20.989557 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e05a7cea-5c27-4a9b-b894-64da2bb1a717 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1279 microversion: 2.1 time: 0.427060 Aug 13 04:31:20.990305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 142/296] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:20 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1279 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:20.999902 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ae8a22fd-600f-497b-bb22-327e5d845672 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:20.999902 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ae8a22fd-600f-497b-bb22-327e5d845672 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:21.012540 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae8a22fd-600f-497b-bb22-327e5d845672 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:21.014001 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae8a22fd-600f-497b-bb22-327e5d845672 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:21.015025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae8a22fd-600f-497b-bb22-327e5d845672 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:21.015962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae8a22fd-600f-497b-bb22-327e5d845672 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:21.057601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b2d91fec-15da-4e7b-90ae-7bd3d2b5b2ed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28034 microversion: 2.20 time: 0.317066 Aug 13 04:31:21.058250 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 155/297] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:20 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28034 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:31:21.113557 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-02d08206-e339-473e-8702-feb34e159797 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:21.114666 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-02d08206-e339-473e-8702-feb34e159797 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:21.122776 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-02d08206-e339-473e-8702-feb34e159797 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:21.123720 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-02d08206-e339-473e-8702-feb34e159797 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:21.124733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-02d08206-e339-473e-8702-feb34e159797 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:21.125322 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-02d08206-e339-473e-8702-feb34e159797 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:21.174672 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ae8a22fd-600f-497b-bb22-327e5d845672 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 27748 microversion: 2.1 time: 0.183270 Aug 13 04:31:21.176096 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 143/298] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:20 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 27748 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:21.425679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-dc83cac8-6aa0-4b42-bdca-e027bda2ae3e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:21.426807 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-dc83cac8-6aa0-4b42-bdca-e027bda2ae3e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:21.443884 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc83cac8-6aa0-4b42-bdca-e027bda2ae3e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:21.445969 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc83cac8-6aa0-4b42-bdca-e027bda2ae3e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:21.447331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc83cac8-6aa0-4b42-bdca-e027bda2ae3e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:21.448962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc83cac8-6aa0-4b42-bdca-e027bda2ae3e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:21.477629 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-02d08206-e339-473e-8702-feb34e159797 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:21.496893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-02d08206-e339-473e-8702-feb34e159797 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.388386 Aug 13 04:31:21.498129 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 156/299] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:21 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:21.511893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-b288891e-28d2-4b48-bfcd-74335fa00c02 req-701ca75e-743a-40c8-9d19-59a54b1a6d1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25395051-723e-4a2e-a22c-7892a0285098", "tag": "ec81d39e-63c0-4679-a7bd-2439e208e2db"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:21.513084 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:21.513084 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:31:21.523345 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-b288891e-28d2-4b48-bfcd-74335fa00c02 req-701ca75e-743a-40c8-9d19-59a54b1a6d1d service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:21.523799 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-b288891e-28d2-4b48-bfcd-74335fa00c02 req-701ca75e-743a-40c8-9d19-59a54b1a6d1d service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:21.536136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-b288891e-28d2-4b48-bfcd-74335fa00c02 req-701ca75e-743a-40c8-9d19-59a54b1a6d1d service nova] Creating event network-changed:ec81d39e-63c0-4679-a7bd-2439e208e2db for instance 25395051-723e-4a2e-a22c-7892a0285098 on hv-cinder-75996 Aug 13 04:31:21.542849 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-b288891e-28d2-4b48-bfcd-74335fa00c02 req-701ca75e-743a-40c8-9d19-59a54b1a6d1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042530 Aug 13 04:31:21.543361 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 157/300] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:21.777545 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-58fc7ae2-864a-4104-a308-085c4d57fdc5 req-cb047089-d38f-4d42-9954-4349ce564302 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9406e71a-2f8b-48ac-81a4-333ecc986171", "tag": "a4b7cf28-b4f2-4d99-892d-76c8c11313cb"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:21.779275 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:21.779275 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:31:21.789170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-58fc7ae2-864a-4104-a308-085c4d57fdc5 req-cb047089-d38f-4d42-9954-4349ce564302 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:21.790338 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-58fc7ae2-864a-4104-a308-085c4d57fdc5 req-cb047089-d38f-4d42-9954-4349ce564302 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:21.791684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dc83cac8-6aa0-4b42-bdca-e027bda2ae3e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:21.801570 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dc83cac8-6aa0-4b42-bdca-e027bda2ae3e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.380738 Aug 13 04:31:21.803876 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 144/301] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:21 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:21.819930 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-58fc7ae2-864a-4104-a308-085c4d57fdc5 req-cb047089-d38f-4d42-9954-4349ce564302 service nova] Creating event network-changed:a4b7cf28-b4f2-4d99-892d-76c8c11313cb for instance 9406e71a-2f8b-48ac-81a4-333ecc986171 on hv-cinder-75996 Aug 13 04:31:21.825769 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-58fc7ae2-864a-4104-a308-085c4d57fdc5 req-cb047089-d38f-4d42-9954-4349ce564302 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053531 Aug 13 04:31:21.826877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 158/302] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:21 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:31:22.006849 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9a127e94-a2f7-421c-bc81-6373435ee732 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:22.007703 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9a127e94-a2f7-421c-bc81-6373435ee732 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:22.014775 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a127e94-a2f7-421c-bc81-6373435ee732 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.015392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a127e94-a2f7-421c-bc81-6373435ee732 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.016779 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a127e94-a2f7-421c-bc81-6373435ee732 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.017903 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a127e94-a2f7-421c-bc81-6373435ee732 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.070388 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-080b9862-be99-4f29-a28f-a782c3ec99de tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:22.071786 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-080b9862-be99-4f29-a28f-a782c3ec99de tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:22.080145 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-080b9862-be99-4f29-a28f-a782c3ec99de tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.081135 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-080b9862-be99-4f29-a28f-a782c3ec99de tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.082327 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-080b9862-be99-4f29-a28f-a782c3ec99de tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.083040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-080b9862-be99-4f29-a28f-a782c3ec99de tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.178713 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-080b9862-be99-4f29-a28f-a782c3ec99de tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28151 microversion: 2.20 time: 0.112372 Aug 13 04:31:22.186432 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 159/303] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:22 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28151 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:31:22.195616 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d1a7f150-3887-4c6e-88f2-82c320df3f64 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:22.198927 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d1a7f150-3887-4c6e-88f2-82c320df3f64 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:22.208494 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1a7f150-3887-4c6e-88f2-82c320df3f64 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.209343 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1a7f150-3887-4c6e-88f2-82c320df3f64 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.211363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1a7f150-3887-4c6e-88f2-82c320df3f64 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.212019 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1a7f150-3887-4c6e-88f2-82c320df3f64 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.311999 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d1a7f150-3887-4c6e-88f2-82c320df3f64 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28109 microversion: 2.1 time: 0.121428 Aug 13 04:31:22.313952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 160/304] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:22 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28109 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:22.320623 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-4a2a103f-92f8-4e6c-bbda-bc3f00e94c33 req-d2f2b70c-f259-4501-b949-8036c872baa6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01df6473-8705-4b35-95b2-844f9267f92e", "name": "network-vif-plugged", "status": "completed", "tag": "a9b019c3-b958-4aa5-8146-7bf11ad373de"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:22.324158 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:22.324158 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:31:22.334817 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-4a2a103f-92f8-4e6c-bbda-bc3f00e94c33 req-d2f2b70c-f259-4501-b949-8036c872baa6 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.335987 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-4a2a103f-92f8-4e6c-bbda-bc3f00e94c33 req-d2f2b70c-f259-4501-b949-8036c872baa6 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.352765 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-4a2a103f-92f8-4e6c-bbda-bc3f00e94c33 req-d2f2b70c-f259-4501-b949-8036c872baa6 service nova] Creating event network-vif-plugged:a9b019c3-b958-4aa5-8146-7bf11ad373de for instance 01df6473-8705-4b35-95b2-844f9267f92e on hv-cinder-75996 Aug 13 04:31:22.358153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-4a2a103f-92f8-4e6c-bbda-bc3f00e94c33 req-d2f2b70c-f259-4501-b949-8036c872baa6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042383 Aug 13 04:31:22.359032 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 161/305] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:22.379335 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9a127e94-a2f7-421c-bc81-6373435ee732 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:22.389108 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9a127e94-a2f7-421c-bc81-6373435ee732 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.385827 Aug 13 04:31:22.390187 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 145/306] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:22 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:22.514311 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-523ba41a-e613-4a95-ad6c-77d0a5da5f01 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:22.515236 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-523ba41a-e613-4a95-ad6c-77d0a5da5f01 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:22.522065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-523ba41a-e613-4a95-ad6c-77d0a5da5f01 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.522760 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-523ba41a-e613-4a95-ad6c-77d0a5da5f01 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.523724 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-523ba41a-e613-4a95-ad6c-77d0a5da5f01 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.524224 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-523ba41a-e613-4a95-ad6c-77d0a5da5f01 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.822747 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-69821a3a-f708-414a-ba8c-900e9d659c35 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:22.823310 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-69821a3a-f708-414a-ba8c-900e9d659c35 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:22.829947 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-69821a3a-f708-414a-ba8c-900e9d659c35 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.830791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-69821a3a-f708-414a-ba8c-900e9d659c35 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.831262 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-69821a3a-f708-414a-ba8c-900e9d659c35 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:22.831706 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-69821a3a-f708-414a-ba8c-900e9d659c35 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:22.903592 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-523ba41a-e613-4a95-ad6c-77d0a5da5f01 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:22.911179 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-523ba41a-e613-4a95-ad6c-77d0a5da5f01 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.400780 Aug 13 04:31:22.911746 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 162/307] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:22 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:23.122491 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-69821a3a-f708-414a-ba8c-900e9d659c35 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:23.129936 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-69821a3a-f708-414a-ba8c-900e9d659c35 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.311471 Aug 13 04:31:23.130520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 146/308] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:22 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:23.194037 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fdfa17dc-cc4b-4242-a965-580d49b6ad52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:23.195824 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fdfa17dc-cc4b-4242-a965-580d49b6ad52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:23.202843 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fdfa17dc-cc4b-4242-a965-580d49b6ad52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:23.203999 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fdfa17dc-cc4b-4242-a965-580d49b6ad52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:23.204790 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fdfa17dc-cc4b-4242-a965-580d49b6ad52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:23.205602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fdfa17dc-cc4b-4242-a965-580d49b6ad52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:23.317294 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fdfa17dc-cc4b-4242-a965-580d49b6ad52 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28151 microversion: 2.20 time: 0.126663 Aug 13 04:31:23.322817 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 163/309] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:23 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28151 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:23.327993 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8406ab28-cca2-4e2f-9a26-8b2c6ec2e361 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:23.328931 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8406ab28-cca2-4e2f-9a26-8b2c6ec2e361 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:23.334716 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8406ab28-cca2-4e2f-9a26-8b2c6ec2e361 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:23.335267 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8406ab28-cca2-4e2f-9a26-8b2c6ec2e361 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:23.336556 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8406ab28-cca2-4e2f-9a26-8b2c6ec2e361 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:23.336986 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8406ab28-cca2-4e2f-9a26-8b2c6ec2e361 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:23.406965 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7fe7297a-37be-4a26-8717-6bac8a4dc0df tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:23.407665 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7fe7297a-37be-4a26-8717-6bac8a4dc0df tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:23.415791 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7fe7297a-37be-4a26-8717-6bac8a4dc0df tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:23.416242 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7fe7297a-37be-4a26-8717-6bac8a4dc0df tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:23.417017 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7fe7297a-37be-4a26-8717-6bac8a4dc0df tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:23.417469 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7fe7297a-37be-4a26-8717-6bac8a4dc0df tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:23.422817 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8406ab28-cca2-4e2f-9a26-8b2c6ec2e361 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28166 microversion: 2.1 time: 0.098240 Aug 13 04:31:23.424513 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 147/310] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:23 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28166 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:23.540350 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7fe7297a-37be-4a26-8717-6bac8a4dc0df tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:23.547526 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7fe7297a-37be-4a26-8717-6bac8a4dc0df tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.144841 Aug 13 04:31:23.548079 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 164/311] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:23 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:23.573676 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-80d60fe0-c8b1-4b7b-9417-ab8941f5455c req-1777662a-f264-4242-93d0-d85ffd2bda63 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eca45425-586a-4015-bea2-2e60a1aa42b3", "tag": "cd209cdf-3517-46ae-b5d5-f413928df01c"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:23.575159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:23.575159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:31:23.582506 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-80d60fe0-c8b1-4b7b-9417-ab8941f5455c req-1777662a-f264-4242-93d0-d85ffd2bda63 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:23.582942 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-80d60fe0-c8b1-4b7b-9417-ab8941f5455c req-1777662a-f264-4242-93d0-d85ffd2bda63 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:23.594798 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-80d60fe0-c8b1-4b7b-9417-ab8941f5455c req-1777662a-f264-4242-93d0-d85ffd2bda63 service nova] Creating event network-changed:cd209cdf-3517-46ae-b5d5-f413928df01c for instance eca45425-586a-4015-bea2-2e60a1aa42b3 on hv-cinder-75996 Aug 13 04:31:23.599400 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-80d60fe0-c8b1-4b7b-9417-ab8941f5455c req-1777662a-f264-4242-93d0-d85ffd2bda63 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030310 Aug 13 04:31:23.600157 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 148/312] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:23 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:31:23.930478 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f576871c-8f7d-4dfe-8278-33890f2a5a33 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:23.930478 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f576871c-8f7d-4dfe-8278-33890f2a5a33 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:23.936704 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f576871c-8f7d-4dfe-8278-33890f2a5a33 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:23.937310 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f576871c-8f7d-4dfe-8278-33890f2a5a33 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:23.938363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f576871c-8f7d-4dfe-8278-33890f2a5a33 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:23.938905 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f576871c-8f7d-4dfe-8278-33890f2a5a33 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:24.149048 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5136ef97-6873-468e-a850-08ef49cbaff1 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:24.150273 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5136ef97-6873-468e-a850-08ef49cbaff1 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:24.156854 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5136ef97-6873-468e-a850-08ef49cbaff1 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:24.157314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5136ef97-6873-468e-a850-08ef49cbaff1 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:24.158299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5136ef97-6873-468e-a850-08ef49cbaff1 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:24.169194 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5136ef97-6873-468e-a850-08ef49cbaff1 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:24.221996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f576871c-8f7d-4dfe-8278-33890f2a5a33 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:24.230836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f576871c-8f7d-4dfe-8278-33890f2a5a33 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.305245 Aug 13 04:31:24.233884 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 165/313] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:23 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:24.329966 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f2b8c364-8138-48f4-a0be-93cc1e0d9b74 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:24.330973 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f2b8c364-8138-48f4-a0be-93cc1e0d9b74 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:24.337561 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2b8c364-8138-48f4-a0be-93cc1e0d9b74 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:24.338423 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2b8c364-8138-48f4-a0be-93cc1e0d9b74 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:24.339213 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2b8c364-8138-48f4-a0be-93cc1e0d9b74 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:24.339647 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2b8c364-8138-48f4-a0be-93cc1e0d9b74 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:24.340399 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5136ef97-6873-468e-a850-08ef49cbaff1 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:24.347880 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5136ef97-6873-468e-a850-08ef49cbaff1 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1314 microversion: 2.1 time: 0.203584 Aug 13 04:31:24.348451 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 149/314] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:24 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:24.406935 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f2b8c364-8138-48f4-a0be-93cc1e0d9b74 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28151 microversion: 2.20 time: 0.080520 Aug 13 04:31:24.407575 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 166/315] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:24 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28151 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:31:24.434108 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0a47adca-abf4-4522-be98-f676c04c7521 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:24.435027 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0a47adca-abf4-4522-be98-f676c04c7521 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:24.440824 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0a47adca-abf4-4522-be98-f676c04c7521 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:24.441279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0a47adca-abf4-4522-be98-f676c04c7521 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:24.442086 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0a47adca-abf4-4522-be98-f676c04c7521 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:24.442521 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0a47adca-abf4-4522-be98-f676c04c7521 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:24.518067 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0a47adca-abf4-4522-be98-f676c04c7521 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28166 microversion: 2.1 time: 0.087264 Aug 13 04:31:24.518881 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 150/316] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:24 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28166 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:24.564895 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d32f101d-5384-4c07-a14b-b750ff9918e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:24.565622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d32f101d-5384-4c07-a14b-b750ff9918e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:24.572728 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d32f101d-5384-4c07-a14b-b750ff9918e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:24.573179 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d32f101d-5384-4c07-a14b-b750ff9918e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:24.573974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d32f101d-5384-4c07-a14b-b750ff9918e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:24.574419 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d32f101d-5384-4c07-a14b-b750ff9918e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:24.701890 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d32f101d-5384-4c07-a14b-b750ff9918e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:24.709321 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d32f101d-5384-4c07-a14b-b750ff9918e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.148450 Aug 13 04:31:24.709915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 167/317] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:24 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:25.248883 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d7258f52-1d4a-4bbe-8175-c09a008f0b67 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:25.249825 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d7258f52-1d4a-4bbe-8175-c09a008f0b67 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:25.256353 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d7258f52-1d4a-4bbe-8175-c09a008f0b67 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:25.256800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d7258f52-1d4a-4bbe-8175-c09a008f0b67 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:25.258347 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d7258f52-1d4a-4bbe-8175-c09a008f0b67 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:25.258789 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d7258f52-1d4a-4bbe-8175-c09a008f0b67 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:25.365379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-97f55cde-7111-4a0d-bc82-b17108066e51 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:25.365900 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-97f55cde-7111-4a0d-bc82-b17108066e51 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:25.372668 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97f55cde-7111-4a0d-bc82-b17108066e51 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:25.373113 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97f55cde-7111-4a0d-bc82-b17108066e51 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:25.374130 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97f55cde-7111-4a0d-bc82-b17108066e51 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:25.374741 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97f55cde-7111-4a0d-bc82-b17108066e51 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:25.385814 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d7258f52-1d4a-4bbe-8175-c09a008f0b67 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:25.393902 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d7258f52-1d4a-4bbe-8175-c09a008f0b67 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.149011 Aug 13 04:31:25.395492 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 151/318] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:25 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:25.419327 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-457c1aa5-6bc6-4b6c-8f3b-f01dbd0649a2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:25.420673 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-457c1aa5-6bc6-4b6c-8f3b-f01dbd0649a2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:25.426806 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-457c1aa5-6bc6-4b6c-8f3b-f01dbd0649a2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:25.427481 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-457c1aa5-6bc6-4b6c-8f3b-f01dbd0649a2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:25.428398 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-457c1aa5-6bc6-4b6c-8f3b-f01dbd0649a2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:25.429754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-457c1aa5-6bc6-4b6c-8f3b-f01dbd0649a2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:25.523694 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-457c1aa5-6bc6-4b6c-8f3b-f01dbd0649a2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28151 microversion: 2.20 time: 0.108270 Aug 13 04:31:25.524809 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 152/319] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:25 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28151 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:25.525348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-97f55cde-7111-4a0d-bc82-b17108066e51 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:25.530109 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c267bd1d-8338-4eb8-ba4a-a91b5fa1f8ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:25.531153 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c267bd1d-8338-4eb8-ba4a-a91b5fa1f8ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:25.533132 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-97f55cde-7111-4a0d-bc82-b17108066e51 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1499 microversion: 2.1 time: 0.171482 Aug 13 04:31:25.533732 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 168/320] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:25 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1499 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:25.537614 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c267bd1d-8338-4eb8-ba4a-a91b5fa1f8ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:25.538066 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c267bd1d-8338-4eb8-ba4a-a91b5fa1f8ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:25.539449 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c267bd1d-8338-4eb8-ba4a-a91b5fa1f8ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:25.539883 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c267bd1d-8338-4eb8-ba4a-a91b5fa1f8ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:25.726568 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bf4c6a5e-b694-4943-9976-630e6a3f8a42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:25.727146 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bf4c6a5e-b694-4943-9976-630e6a3f8a42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:25.733675 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf4c6a5e-b694-4943-9976-630e6a3f8a42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:25.734134 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf4c6a5e-b694-4943-9976-630e6a3f8a42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:25.734913 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf4c6a5e-b694-4943-9976-630e6a3f8a42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:25.735350 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf4c6a5e-b694-4943-9976-630e6a3f8a42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:25.858144 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bf4c6a5e-b694-4943-9976-630e6a3f8a42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:25.865498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bf4c6a5e-b694-4943-9976-630e6a3f8a42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.143171 Aug 13 04:31:25.866101 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 169/321] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:25 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:26.411218 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b3990e0c-a4ae-48e1-8ba7-ac791478a5c5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:26.411884 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b3990e0c-a4ae-48e1-8ba7-ac791478a5c5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:26.418080 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b3990e0c-a4ae-48e1-8ba7-ac791478a5c5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:26.418523 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b3990e0c-a4ae-48e1-8ba7-ac791478a5c5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:26.419286 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b3990e0c-a4ae-48e1-8ba7-ac791478a5c5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:26.419715 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b3990e0c-a4ae-48e1-8ba7-ac791478a5c5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:26.549600 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b3990e0c-a4ae-48e1-8ba7-ac791478a5c5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:26.557214 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b3990e0c-a4ae-48e1-8ba7-ac791478a5c5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.149715 Aug 13 04:31:26.557793 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 170/322] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:26 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:26.562095 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-34fd8e20-5cf3-4292-b9b5-2f9917bb3d54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:26.563038 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-34fd8e20-5cf3-4292-b9b5-2f9917bb3d54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:26.568424 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34fd8e20-5cf3-4292-b9b5-2f9917bb3d54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:26.568872 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34fd8e20-5cf3-4292-b9b5-2f9917bb3d54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:26.570712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34fd8e20-5cf3-4292-b9b5-2f9917bb3d54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:26.570712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34fd8e20-5cf3-4292-b9b5-2f9917bb3d54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:28.813244 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c267bd1d-8338-4eb8-ba4a-a91b5fa1f8ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28166 microversion: 2.1 time: 3.287019 Aug 13 04:31:28.817564 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 153/323] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:25 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28166 bytes in 3289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:31:28.818861 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3eae96ed-9d89-4203-a806-37a480a44ae3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:28.820198 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3eae96ed-9d89-4203-a806-37a480a44ae3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:28.826757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3eae96ed-9d89-4203-a806-37a480a44ae3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:28.827150 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3eae96ed-9d89-4203-a806-37a480a44ae3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:28.827924 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3eae96ed-9d89-4203-a806-37a480a44ae3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:28.828486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3eae96ed-9d89-4203-a806-37a480a44ae3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:28.854989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-34fd8e20-5cf3-4292-b9b5-2f9917bb3d54 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28151 microversion: 2.20 time: 2.295904 Aug 13 04:31:28.856023 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 171/324] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:26 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28151 bytes in 2297 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:28.860644 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-430a2f09-4f5c-4a42-9be4-362b26b0cc60 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:28.861384 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-430a2f09-4f5c-4a42-9be4-362b26b0cc60 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:28.868859 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-430a2f09-4f5c-4a42-9be4-362b26b0cc60 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:28.869367 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-430a2f09-4f5c-4a42-9be4-362b26b0cc60 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:28.870167 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-430a2f09-4f5c-4a42-9be4-362b26b0cc60 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:28.870714 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-430a2f09-4f5c-4a42-9be4-362b26b0cc60 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:28.982957 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3eae96ed-9d89-4203-a806-37a480a44ae3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:28.990626 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3eae96ed-9d89-4203-a806-37a480a44ae3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.175502 Aug 13 04:31:28.991198 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 154/325] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:28 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:29.032758 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-430a2f09-4f5c-4a42-9be4-362b26b0cc60 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:29.040071 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-430a2f09-4f5c-4a42-9be4-362b26b0cc60 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.183205 Aug 13 04:31:29.040622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 172/326] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:28 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:29.826076 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-00cac3df-0ce3-49f7-9f51-b04523d298b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:29.826996 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-00cac3df-0ce3-49f7-9f51-b04523d298b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:29.833341 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00cac3df-0ce3-49f7-9f51-b04523d298b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:29.833832 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00cac3df-0ce3-49f7-9f51-b04523d298b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:29.834599 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00cac3df-0ce3-49f7-9f51-b04523d298b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:29.835113 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00cac3df-0ce3-49f7-9f51-b04523d298b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:29.866608 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0d46e8db-9d63-48df-8b44-7822eaac97c5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:29.867513 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0d46e8db-9d63-48df-8b44-7822eaac97c5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:29.873686 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0d46e8db-9d63-48df-8b44-7822eaac97c5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:29.874121 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0d46e8db-9d63-48df-8b44-7822eaac97c5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:29.874869 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0d46e8db-9d63-48df-8b44-7822eaac97c5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:29.875290 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0d46e8db-9d63-48df-8b44-7822eaac97c5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:32.196656 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-00cac3df-0ce3-49f7-9f51-b04523d298b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28166 microversion: 2.1 time: 2.374297 Aug 13 04:31:32.197670 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 155/327] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:29 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28166 bytes in 2376 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:32.200179 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0d46e8db-9d63-48df-8b44-7822eaac97c5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28151 microversion: 2.20 time: 2.337176 Aug 13 04:31:32.204321 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 173/328] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:29 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28151 bytes in 2339 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:31:32.204484 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-18796c7f-83a7-4ddb-bbbd-40a6b50bd7c6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:32.204484 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-18796c7f-83a7-4ddb-bbbd-40a6b50bd7c6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:32.205878 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-78bf8159-1183-49da-9f2e-6c51292be53a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:32.206698 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-78bf8159-1183-49da-9f2e-6c51292be53a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:32.209337 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-18796c7f-83a7-4ddb-bbbd-40a6b50bd7c6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:32.209813 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-18796c7f-83a7-4ddb-bbbd-40a6b50bd7c6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:32.210711 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-18796c7f-83a7-4ddb-bbbd-40a6b50bd7c6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:32.211172 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-18796c7f-83a7-4ddb-bbbd-40a6b50bd7c6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:32.214369 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-78bf8159-1183-49da-9f2e-6c51292be53a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:32.216141 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-78bf8159-1183-49da-9f2e-6c51292be53a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:32.216141 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-78bf8159-1183-49da-9f2e-6c51292be53a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:32.216141 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-78bf8159-1183-49da-9f2e-6c51292be53a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:32.388274 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-18796c7f-83a7-4ddb-bbbd-40a6b50bd7c6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:32.398590 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-18796c7f-83a7-4ddb-bbbd-40a6b50bd7c6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.199724 Aug 13 04:31:32.400030 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 156/329] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:32 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:32.411043 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-78bf8159-1183-49da-9f2e-6c51292be53a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:32.418777 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-78bf8159-1183-49da-9f2e-6c51292be53a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.216553 Aug 13 04:31:32.419332 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 174/330] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:32 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:32.614065 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7ea5e815-e2c6-4eb5-93b8-45e1ac90654c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:32.614585 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7ea5e815-e2c6-4eb5-93b8-45e1ac90654c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:32.620892 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ea5e815-e2c6-4eb5-93b8-45e1ac90654c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:32.621340 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ea5e815-e2c6-4eb5-93b8-45e1ac90654c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:32.622136 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ea5e815-e2c6-4eb5-93b8-45e1ac90654c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:32.622573 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ea5e815-e2c6-4eb5-93b8-45e1ac90654c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:32.649192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7ea5e815-e2c6-4eb5-93b8-45e1ac90654c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:31:32.724662 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7ea5e815-e2c6-4eb5-93b8-45e1ac90654c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "DELETE /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 204 len: 0 microversion: 2.1 time: 0.113858 Aug 13 04:31:32.725367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 157/331] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:31:32 2021] DELETE /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:31:32.735510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-209195c8-2bdd-4fdf-be84-6531156c3f1e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:32.736127 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-209195c8-2bdd-4fdf-be84-6531156c3f1e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:32.741876 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-209195c8-2bdd-4fdf-be84-6531156c3f1e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:32.742321 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-209195c8-2bdd-4fdf-be84-6531156c3f1e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:32.743087 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-209195c8-2bdd-4fdf-be84-6531156c3f1e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:32.743521 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-209195c8-2bdd-4fdf-be84-6531156c3f1e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:32.869036 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-209195c8-2bdd-4fdf-be84-6531156c3f1e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:32.877109 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-209195c8-2bdd-4fdf-be84-6531156c3f1e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1505 microversion: 2.1 time: 0.146482 Aug 13 04:31:32.877796 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 175/332] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:32 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1505 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:33.208952 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d9e5a043-b6a5-456a-b138-f5f66325aedb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:33.209982 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d9e5a043-b6a5-456a-b138-f5f66325aedb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:33.211522 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e36d983f-7574-4624-beca-c05d486a7b17 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:33.212522 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e36d983f-7574-4624-beca-c05d486a7b17 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:33.216558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d9e5a043-b6a5-456a-b138-f5f66325aedb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:33.217002 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d9e5a043-b6a5-456a-b138-f5f66325aedb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:33.217817 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d9e5a043-b6a5-456a-b138-f5f66325aedb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:33.218250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d9e5a043-b6a5-456a-b138-f5f66325aedb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:33.218788 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e36d983f-7574-4624-beca-c05d486a7b17 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:33.219243 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e36d983f-7574-4624-beca-c05d486a7b17 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:33.220040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e36d983f-7574-4624-beca-c05d486a7b17 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:33.220476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e36d983f-7574-4624-beca-c05d486a7b17 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:33.300123 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d9e5a043-b6a5-456a-b138-f5f66325aedb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28166 microversion: 2.1 time: 0.095026 Aug 13 04:31:33.300706 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 158/333] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:33 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28166 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:31:33.321458 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e36d983f-7574-4624-beca-c05d486a7b17 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28151 microversion: 2.20 time: 0.113478 Aug 13 04:31:33.322150 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 176/334] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:33 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28151 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:31:33.416692 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2e17a8a2-eaa2-4d2b-9532-33820ef6004a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:33.417396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2e17a8a2-eaa2-4d2b-9532-33820ef6004a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:33.423907 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e17a8a2-eaa2-4d2b-9532-33820ef6004a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:33.424352 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e17a8a2-eaa2-4d2b-9532-33820ef6004a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:33.425118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e17a8a2-eaa2-4d2b-9532-33820ef6004a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:33.425586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e17a8a2-eaa2-4d2b-9532-33820ef6004a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:33.435885 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1375f289-4b00-447f-a1ce-15ec7129b83d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:33.436574 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1375f289-4b00-447f-a1ce-15ec7129b83d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:33.442934 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1375f289-4b00-447f-a1ce-15ec7129b83d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:33.443380 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1375f289-4b00-447f-a1ce-15ec7129b83d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:33.444141 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1375f289-4b00-447f-a1ce-15ec7129b83d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:33.445772 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1375f289-4b00-447f-a1ce-15ec7129b83d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:33.825210 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2e17a8a2-eaa2-4d2b-9532-33820ef6004a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:33.830131 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1375f289-4b00-447f-a1ce-15ec7129b83d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:33.832683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2e17a8a2-eaa2-4d2b-9532-33820ef6004a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.420348 Aug 13 04:31:33.834135 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 159/335] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:33 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 422 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:33.839262 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1375f289-4b00-447f-a1ce-15ec7129b83d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.407209 Aug 13 04:31:33.848753 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 177/336] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:33 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:33.894775 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c2add98b-43f0-461f-a5a8-06eb9c3f91c6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:33.895371 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c2add98b-43f0-461f-a5a8-06eb9c3f91c6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:33.901243 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2add98b-43f0-461f-a5a8-06eb9c3f91c6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:33.901716 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2add98b-43f0-461f-a5a8-06eb9c3f91c6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:33.902474 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2add98b-43f0-461f-a5a8-06eb9c3f91c6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:33.902901 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2add98b-43f0-461f-a5a8-06eb9c3f91c6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:34.024337 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c2add98b-43f0-461f-a5a8-06eb9c3f91c6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:34.031635 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c2add98b-43f0-461f-a5a8-06eb9c3f91c6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1505 microversion: 2.1 time: 0.140500 Aug 13 04:31:34.032192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 160/337] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:33 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1505 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:34.312199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c9d4fe13-a425-4eb2-ac40-692870ba21ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:34.313099 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c9d4fe13-a425-4eb2-ac40-692870ba21ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:34.319227 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c9d4fe13-a425-4eb2-ac40-692870ba21ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:34.320696 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c9d4fe13-a425-4eb2-ac40-692870ba21ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:34.321295 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c9d4fe13-a425-4eb2-ac40-692870ba21ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:34.321739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c9d4fe13-a425-4eb2-ac40-692870ba21ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:34.331932 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3b67d456-401a-4113-a892-f43df7b49ef8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:34.332835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3b67d456-401a-4113-a892-f43df7b49ef8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:34.339630 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b67d456-401a-4113-a892-f43df7b49ef8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:34.340070 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b67d456-401a-4113-a892-f43df7b49ef8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:34.340830 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b67d456-401a-4113-a892-f43df7b49ef8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:34.341255 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b67d456-401a-4113-a892-f43df7b49ef8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:34.404862 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c9d4fe13-a425-4eb2-ac40-692870ba21ce tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28453 microversion: 2.1 time: 0.096153 Aug 13 04:31:34.405823 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 178/338] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:34 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28453 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:34.431335 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3b67d456-401a-4113-a892-f43df7b49ef8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28442 microversion: 2.20 time: 0.102824 Aug 13 04:31:34.431963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 161/339] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:34 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28442 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:31:34.850943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8156a248-bf3e-4a4d-86dc-c10efde55430 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:34.851640 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8156a248-bf3e-4a4d-86dc-c10efde55430 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:34.856696 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-72c8b2ee-c331-498c-9afe-6f0783c14bb4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:34.857707 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-72c8b2ee-c331-498c-9afe-6f0783c14bb4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:34.858176 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8156a248-bf3e-4a4d-86dc-c10efde55430 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:34.858624 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8156a248-bf3e-4a4d-86dc-c10efde55430 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:34.859411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8156a248-bf3e-4a4d-86dc-c10efde55430 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:34.859847 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8156a248-bf3e-4a4d-86dc-c10efde55430 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:34.864527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-72c8b2ee-c331-498c-9afe-6f0783c14bb4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:34.864972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-72c8b2ee-c331-498c-9afe-6f0783c14bb4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:34.865759 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-72c8b2ee-c331-498c-9afe-6f0783c14bb4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:34.866732 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-72c8b2ee-c331-498c-9afe-6f0783c14bb4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:35.144556 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-72c8b2ee-c331-498c-9afe-6f0783c14bb4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:35.164322 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-8156a248-bf3e-4a4d-86dc-c10efde55430 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:35.164639 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-72c8b2ee-c331-498c-9afe-6f0783c14bb4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.310743 Aug 13 04:31:35.173980 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 162/340] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:34 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:35.173980 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-500e2628-651c-4f8e-8d20-e9147cd87a8f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:35.173980 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-500e2628-651c-4f8e-8d20-e9147cd87a8f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:35.181297 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-500e2628-651c-4f8e-8d20-e9147cd87a8f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:35.181999 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-500e2628-651c-4f8e-8d20-e9147cd87a8f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:35.182894 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-500e2628-651c-4f8e-8d20-e9147cd87a8f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:35.183435 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-500e2628-651c-4f8e-8d20-e9147cd87a8f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:35.183569 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8156a248-bf3e-4a4d-86dc-c10efde55430 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.336551 Aug 13 04:31:35.184316 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 179/341] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:34 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:35.273955 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-bf4791ad-7742-4367-a5b4-212c1a3cc797 req-06d67143-397b-4d50-892c-026590f8dcb1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25395051-723e-4a2e-a22c-7892a0285098", "name": "network-vif-plugged", "status": "completed", "tag": "ec81d39e-63c0-4679-a7bd-2439e208e2db"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:35.275582 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:35.275582 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:31:35.282974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-bf4791ad-7742-4367-a5b4-212c1a3cc797 req-06d67143-397b-4d50-892c-026590f8dcb1 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:35.283414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-bf4791ad-7742-4367-a5b4-212c1a3cc797 req-06d67143-397b-4d50-892c-026590f8dcb1 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:35.296351 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-bf4791ad-7742-4367-a5b4-212c1a3cc797 req-06d67143-397b-4d50-892c-026590f8dcb1 service nova] Creating event network-vif-plugged:ec81d39e-63c0-4679-a7bd-2439e208e2db for instance 25395051-723e-4a2e-a22c-7892a0285098 on hv-cinder-75996 Aug 13 04:31:35.302122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-bf4791ad-7742-4367-a5b4-212c1a3cc797 req-06d67143-397b-4d50-892c-026590f8dcb1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032000 Aug 13 04:31:35.302717 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 180/342] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:31:35.396934 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-93273a7d-f290-4837-b328-ab722ef4d8b0 req-8c8b789a-7130-42e4-9e5b-6aefa2e40515 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01df6473-8705-4b35-95b2-844f9267f92e", "name": "network-vif-deleted", "tag": "a9b019c3-b958-4aa5-8146-7bf11ad373de"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:35.402625 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:35.402625 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:31:35.404257 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-500e2628-651c-4f8e-8d20-e9147cd87a8f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:35.415776 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-93273a7d-f290-4837-b328-ab722ef4d8b0 req-8c8b789a-7130-42e4-9e5b-6aefa2e40515 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:35.416575 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-93273a7d-f290-4837-b328-ab722ef4d8b0 req-8c8b789a-7130-42e4-9e5b-6aefa2e40515 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:35.421208 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-500e2628-651c-4f8e-8d20-e9147cd87a8f tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 200 len: 1505 microversion: 2.1 time: 0.254536 Aug 13 04:31:35.421649 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 163/343] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:35 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 1505 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:35.427097 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-056f419d-b982-4203-a1b1-e3613a37a340 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:35.428058 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-056f419d-b982-4203-a1b1-e3613a37a340 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:35.439932 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-93273a7d-f290-4837-b328-ab722ef4d8b0 req-8c8b789a-7130-42e4-9e5b-6aefa2e40515 service nova] Creating event network-vif-deleted:a9b019c3-b958-4aa5-8146-7bf11ad373de for instance 01df6473-8705-4b35-95b2-844f9267f92e on hv-cinder-75996 Aug 13 04:31:35.442889 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-056f419d-b982-4203-a1b1-e3613a37a340 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:35.443302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-056f419d-b982-4203-a1b1-e3613a37a340 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:35.444091 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-056f419d-b982-4203-a1b1-e3613a37a340 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:35.445546 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-056f419d-b982-4203-a1b1-e3613a37a340 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:35.446617 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-93273a7d-f290-4837-b328-ab722ef4d8b0 req-8c8b789a-7130-42e4-9e5b-6aefa2e40515 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062741 Aug 13 04:31:35.447215 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 181/344] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:35 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:35.455578 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ed52e99b-cdf4-46a9-ba33-bd1021d8fefd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:35.456731 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ed52e99b-cdf4-46a9-ba33-bd1021d8fefd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:35.465108 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ed52e99b-cdf4-46a9-ba33-bd1021d8fefd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:35.465563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ed52e99b-cdf4-46a9-ba33-bd1021d8fefd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:35.466534 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ed52e99b-cdf4-46a9-ba33-bd1021d8fefd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:35.467110 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ed52e99b-cdf4-46a9-ba33-bd1021d8fefd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:35.711076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ed52e99b-cdf4-46a9-ba33-bd1021d8fefd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28584 microversion: 2.20 time: 0.261238 Aug 13 04:31:35.712973 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 182/345] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:35 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28584 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:35.715071 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-056f419d-b982-4203-a1b1-e3613a37a340 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28594 microversion: 2.1 time: 0.291494 Aug 13 04:31:35.717020 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 164/346] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:35 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28594 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:36.191164 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a283e64b-3960-4c20-a3c2-a032c2b33e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:36.192060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a283e64b-3960-4c20-a3c2-a032c2b33e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:36.203777 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b157b0be-3716-45d4-8279-23b7e7af6339 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:36.204473 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b157b0be-3716-45d4-8279-23b7e7af6339 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:36.213495 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a283e64b-3960-4c20-a3c2-a032c2b33e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:36.213950 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a283e64b-3960-4c20-a3c2-a032c2b33e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:36.214733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a283e64b-3960-4c20-a3c2-a032c2b33e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:36.215171 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a283e64b-3960-4c20-a3c2-a032c2b33e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:36.223262 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b157b0be-3716-45d4-8279-23b7e7af6339 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:36.223262 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b157b0be-3716-45d4-8279-23b7e7af6339 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:36.223262 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b157b0be-3716-45d4-8279-23b7e7af6339 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:36.223262 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b157b0be-3716-45d4-8279-23b7e7af6339 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:36.451067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a283e64b-3960-4c20-a3c2-a032c2b33e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:36.456255 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b157b0be-3716-45d4-8279-23b7e7af6339 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:36.460497 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a283e64b-3960-4c20-a3c2-a032c2b33e64 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.281794 Aug 13 04:31:36.461123 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 183/347] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:36 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:36.464690 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b157b0be-3716-45d4-8279-23b7e7af6339 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.267262 Aug 13 04:31:36.465241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 165/348] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:36 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:36.465923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7056a064-349c-4223-b61b-57366aafee9c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:36.466543 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7056a064-349c-4223-b61b-57366aafee9c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 01df6473-8705-4b35-95b2-844f9267f92e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:36.473297 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7056a064-349c-4223-b61b-57366aafee9c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:36.473768 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7056a064-349c-4223-b61b-57366aafee9c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:36.474531 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7056a064-349c-4223-b61b-57366aafee9c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:36.474958 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7056a064-349c-4223-b61b-57366aafee9c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:36.490044 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-7056a064-349c-4223-b61b-57366aafee9c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] HTTP exception thrown: Instance 01df6473-8705-4b35-95b2-844f9267f92e could not be found. Aug 13 04:31:36.490627 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7056a064-349c-4223-b61b-57366aafee9c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Returning 404 to user: Instance 01df6473-8705-4b35-95b2-844f9267f92e could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:31:36.491644 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7056a064-349c-4223-b61b-57366aafee9c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e" status: 404 len: 111 microversion: 2.1 time: 0.029216 Aug 13 04:31:36.492383 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 184/349] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:36 2021] GET /compute/v2.1/servers/01df6473-8705-4b35-95b2-844f9267f92e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:31:36.594066 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-340637458", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "networks": [{"uuid": "0ac580e7-d1b2-46c1-ae42-d5c12c542de0"}]}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:36.647148 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.network.neutron [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] validate_networks() for [('0ac580e7-d1b2-46c1-ae42-d5c12c542de0', None, None, None)] {{(pid=108287) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:31:36.725060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fa039223-3d89-4a16-bec3-cbc9944c44d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:36.726256 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fa039223-3d89-4a16-bec3-cbc9944c44d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:36.732022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa039223-3d89-4a16-bec3-cbc9944c44d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:36.732461 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa039223-3d89-4a16-bec3-cbc9944c44d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:36.733229 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa039223-3d89-4a16-bec3-cbc9944c44d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:36.733681 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa039223-3d89-4a16-bec3-cbc9944c44d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:36.809364 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fa039223-3d89-4a16-bec3-cbc9944c44d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28609 microversion: 2.20 time: 0.089423 Aug 13 04:31:36.810729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 185/350] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:36 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28609 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:31:36.817026 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ac2a06c1-5963-4282-8b28-b8bf21502df1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:36.818069 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ac2a06c1-5963-4282-8b28-b8bf21502df1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:36.825770 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ac2a06c1-5963-4282-8b28-b8bf21502df1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:36.826223 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ac2a06c1-5963-4282-8b28-b8bf21502df1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:36.827007 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ac2a06c1-5963-4282-8b28-b8bf21502df1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:36.827446 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ac2a06c1-5963-4282-8b28-b8bf21502df1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:36.904685 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ac2a06c1-5963-4282-8b28-b8bf21502df1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28621 microversion: 2.1 time: 0.092309 Aug 13 04:31:36.908604 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 186/351] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:36 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28621 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:37.021087 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Flavor limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:31:37.021648 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Image limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:31:37.022230 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Flavor pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:31:37.022767 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Image pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:31:37.023249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:31:37.044512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.045042 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:37.046086 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.046706 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:37.082508 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Getting quotas for project af89c6f3ec974defb8233cfefa31e914. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:31:37.089609 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Getting quotas for user 4921641e77d841e98ecc91f020df4251 and project af89c6f3ec974defb8233cfefa31e914. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:31:37.102509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Going to run 1 instances... {{(pid=108287) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:31:37.105159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:31:37.152116 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-de90b622-3b71-43f0-9d1b-2e3a16c41a06 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.562050 Aug 13 04:31:37.153041 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 166/352] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:31:36 2021] POST /compute/v2.1/servers => generated 380 bytes in 564 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:31:37.165037 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d608f8d6-1493-44e2-861b-e49ebe84c5d0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:37.165779 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d608f8d6-1493-44e2-861b-e49ebe84c5d0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:37.231296 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d608f8d6-1493-44e2-861b-e49ebe84c5d0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:37.237842 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d608f8d6-1493-44e2-861b-e49ebe84c5d0 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1213 microversion: 2.1 time: 0.078535 Aug 13 04:31:37.238432 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 187/353] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:37 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1213 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:37.334793 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-aa6b7a1c-ca28-4479-b466-97d50a032657 req-c6762962-01c2-477f-90ec-8438374ae711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9406e71a-2f8b-48ac-81a4-333ecc986171", "name": "network-vif-plugged", "status": "completed", "tag": "a4b7cf28-b4f2-4d99-892d-76c8c11313cb"}, {"server_uuid": "eca45425-586a-4015-bea2-2e60a1aa42b3", "name": "network-vif-plugged", "status": "completed", "tag": "cd209cdf-3517-46ae-b5d5-f413928df01c"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:37.336875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:37.336875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:31:37.345992 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-aa6b7a1c-ca28-4479-b466-97d50a032657 req-c6762962-01c2-477f-90ec-8438374ae711 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.346696 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-aa6b7a1c-ca28-4479-b466-97d50a032657 req-c6762962-01c2-477f-90ec-8438374ae711 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:37.372034 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-aa6b7a1c-ca28-4479-b466-97d50a032657 req-c6762962-01c2-477f-90ec-8438374ae711 service nova] Creating event network-vif-plugged:a4b7cf28-b4f2-4d99-892d-76c8c11313cb for instance 9406e71a-2f8b-48ac-81a4-333ecc986171 on hv-cinder-75996 Aug 13 04:31:37.373225 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-aa6b7a1c-ca28-4479-b466-97d50a032657 req-c6762962-01c2-477f-90ec-8438374ae711 service nova] Creating event network-vif-plugged:cd209cdf-3517-46ae-b5d5-f413928df01c for instance eca45425-586a-4015-bea2-2e60a1aa42b3 on hv-cinder-75996 Aug 13 04:31:37.387275 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-aa6b7a1c-ca28-4479-b466-97d50a032657 req-c6762962-01c2-477f-90ec-8438374ae711 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.055319 Aug 13 04:31:37.388229 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 167/354] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:37 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:37.481190 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f11c4b9e-50ad-42d5-8662-10b93130827c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:37.482299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2717fe43-8950-4113-b523-e51d0c92f394 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:37.483082 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f11c4b9e-50ad-42d5-8662-10b93130827c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:37.483200 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2717fe43-8950-4113-b523-e51d0c92f394 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:37.496420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2717fe43-8950-4113-b523-e51d0c92f394 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.496838 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f11c4b9e-50ad-42d5-8662-10b93130827c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.497782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f11c4b9e-50ad-42d5-8662-10b93130827c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:37.498772 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f11c4b9e-50ad-42d5-8662-10b93130827c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.499106 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2717fe43-8950-4113-b523-e51d0c92f394 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:37.499249 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f11c4b9e-50ad-42d5-8662-10b93130827c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:37.500011 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2717fe43-8950-4113-b523-e51d0c92f394 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.500462 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2717fe43-8950-4113-b523-e51d0c92f394 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:37.834804 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f11c4b9e-50ad-42d5-8662-10b93130827c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:37.846559 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f11c4b9e-50ad-42d5-8662-10b93130827c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.372305 Aug 13 04:31:37.847389 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 188/355] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:37 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:37.853068 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-39ce19e3-7110-4246-9478-061b4d2f96af tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:37.854122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-39ce19e3-7110-4246-9478-061b4d2f96af tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:37.859729 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2717fe43-8950-4113-b523-e51d0c92f394 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:37.870998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-39ce19e3-7110-4246-9478-061b4d2f96af tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.870998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-39ce19e3-7110-4246-9478-061b4d2f96af tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:37.870998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-39ce19e3-7110-4246-9478-061b4d2f96af tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.870998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-39ce19e3-7110-4246-9478-061b4d2f96af tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:37.876161 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2717fe43-8950-4113-b523-e51d0c92f394 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.398195 Aug 13 04:31:37.876925 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 168/356] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:37 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:37.917329 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3eb0e086-cc86-4ae9-8260-12d8cde2e915 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:37.918396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3eb0e086-cc86-4ae9-8260-12d8cde2e915 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:37.924874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3eb0e086-cc86-4ae9-8260-12d8cde2e915 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.925321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3eb0e086-cc86-4ae9-8260-12d8cde2e915 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:37.926130 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3eb0e086-cc86-4ae9-8260-12d8cde2e915 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:37.926564 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3eb0e086-cc86-4ae9-8260-12d8cde2e915 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:38.076186 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3eb0e086-cc86-4ae9-8260-12d8cde2e915 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28621 microversion: 2.1 time: 0.163687 Aug 13 04:31:38.080124 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 169/357] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:37 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28621 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:31:38.081401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-39ce19e3-7110-4246-9478-061b4d2f96af tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28609 microversion: 2.20 time: 0.231890 Aug 13 04:31:38.082065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 189/358] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:37 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28609 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:38.255417 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b79fd6c1-3aa0-4b1f-8120-43646db31ca6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:38.256075 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b79fd6c1-3aa0-4b1f-8120-43646db31ca6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:38.263422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b79fd6c1-3aa0-4b1f-8120-43646db31ca6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:38.263933 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b79fd6c1-3aa0-4b1f-8120-43646db31ca6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:38.264653 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b79fd6c1-3aa0-4b1f-8120-43646db31ca6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:38.265262 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b79fd6c1-3aa0-4b1f-8120-43646db31ca6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:38.337134 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b79fd6c1-3aa0-4b1f-8120-43646db31ca6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:38.345596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b79fd6c1-3aa0-4b1f-8120-43646db31ca6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1265 microversion: 2.1 time: 0.094137 Aug 13 04:31:38.346290 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 170/359] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:38 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1265 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:38.864554 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3822f6b9-2329-408d-ae71-6e0eeb104d74 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:38.865259 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3822f6b9-2329-408d-ae71-6e0eeb104d74 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:38.871809 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3822f6b9-2329-408d-ae71-6e0eeb104d74 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:38.872271 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3822f6b9-2329-408d-ae71-6e0eeb104d74 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:38.873052 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3822f6b9-2329-408d-ae71-6e0eeb104d74 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:38.873527 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3822f6b9-2329-408d-ae71-6e0eeb104d74 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:38.893959 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-eda61288-67f7-4318-ab3a-97f9383d7729 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:38.894544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-eda61288-67f7-4318-ab3a-97f9383d7729 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:38.901112 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eda61288-67f7-4318-ab3a-97f9383d7729 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:38.901845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eda61288-67f7-4318-ab3a-97f9383d7729 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:38.902954 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eda61288-67f7-4318-ab3a-97f9383d7729 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:38.903552 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eda61288-67f7-4318-ab3a-97f9383d7729 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:39.166416 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3822f6b9-2329-408d-ae71-6e0eeb104d74 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:39.176952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3822f6b9-2329-408d-ae71-6e0eeb104d74 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1318 microversion: 2.1 time: 0.316606 Aug 13 04:31:39.177534 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 190/360] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:38 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1318 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:39.190777 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c4694481-4e54-4e09-a7f2-bf13d2cdeccc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:39.191766 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c4694481-4e54-4e09-a7f2-bf13d2cdeccc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:39.192906 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-eda61288-67f7-4318-ab3a-97f9383d7729 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:39.204045 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c4694481-4e54-4e09-a7f2-bf13d2cdeccc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:39.204509 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c4694481-4e54-4e09-a7f2-bf13d2cdeccc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:39.205334 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c4694481-4e54-4e09-a7f2-bf13d2cdeccc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:39.206024 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c4694481-4e54-4e09-a7f2-bf13d2cdeccc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:39.208068 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-eda61288-67f7-4318-ab3a-97f9383d7729 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.317605 Aug 13 04:31:39.217856 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 171/361] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:38 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:39.231302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-603678d8-8df6-4a79-baa4-eb4d4de09789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:39.235797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-603678d8-8df6-4a79-baa4-eb4d4de09789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:39.244797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-603678d8-8df6-4a79-baa4-eb4d4de09789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:39.245013 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-603678d8-8df6-4a79-baa4-eb4d4de09789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:39.245864 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-603678d8-8df6-4a79-baa4-eb4d4de09789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:39.246300 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-603678d8-8df6-4a79-baa4-eb4d4de09789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.043003 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c4694481-4e54-4e09-a7f2-bf13d2cdeccc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28621 microversion: 2.1 time: 2.861464 Aug 13 04:31:42.046032 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 191/362] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:39 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28621 bytes in 2866 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:42.048589 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-603678d8-8df6-4a79-baa4-eb4d4de09789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28609 microversion: 2.20 time: 2.828918 Aug 13 04:31:42.049821 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 172/363] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:39 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28609 bytes in 2831 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:42.050762 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-506964af-def5-491b-8102-dc29673c2196 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:42.051589 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-506964af-def5-491b-8102-dc29673c2196 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:42.058717 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-cf510667-6f5c-4354-a726-3db928e1f677 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:42.059327 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-cf510667-6f5c-4354-a726-3db928e1f677 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:42.060670 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-506964af-def5-491b-8102-dc29673c2196 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.061131 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-506964af-def5-491b-8102-dc29673c2196 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.062663 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-506964af-def5-491b-8102-dc29673c2196 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.063122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-506964af-def5-491b-8102-dc29673c2196 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.068643 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cf510667-6f5c-4354-a726-3db928e1f677 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.070925 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cf510667-6f5c-4354-a726-3db928e1f677 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.072353 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cf510667-6f5c-4354-a726-3db928e1f677 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.074498 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cf510667-6f5c-4354-a726-3db928e1f677 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.404656 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-cf510667-6f5c-4354-a726-3db928e1f677 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:42.412475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-cf510667-6f5c-4354-a726-3db928e1f677 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1321 microversion: 2.1 time: 0.361371 Aug 13 04:31:42.413700 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 173/364] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:42 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1321 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:42.425191 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ee65ad4a-fe71-4537-b360-46a499fc5857 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:42.425850 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ee65ad4a-fe71-4537-b360-46a499fc5857 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:42.430502 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-506964af-def5-491b-8102-dc29673c2196 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:42.432513 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ee65ad4a-fe71-4537-b360-46a499fc5857 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.433036 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ee65ad4a-fe71-4537-b360-46a499fc5857 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.433921 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ee65ad4a-fe71-4537-b360-46a499fc5857 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.434361 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ee65ad4a-fe71-4537-b360-46a499fc5857 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.438192 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-506964af-def5-491b-8102-dc29673c2196 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1313 microversion: 2.1 time: 0.392345 Aug 13 04:31:42.438846 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 192/365] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:42 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1313 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:42.633574 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ee65ad4a-fe71-4537-b360-46a499fc5857 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:42.648590 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ee65ad4a-fe71-4537-b360-46a499fc5857 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1508 microversion: 2.1 time: 0.233087 Aug 13 04:31:42.649450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 174/366] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:42 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1508 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:42.665307 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3aa50cb4-222f-471e-868c-a0bfe2e82402 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69ca6413-ed76-423e-a5ff-2aa36241d555"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:42.666439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3aa50cb4-222f-471e-868c-a0bfe2e82402 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:42.672284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3aa50cb4-222f-471e-868c-a0bfe2e82402 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.672945 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3aa50cb4-222f-471e-868c-a0bfe2e82402 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.673546 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3aa50cb4-222f-471e-868c-a0bfe2e82402 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.673973 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3aa50cb4-222f-471e-868c-a0bfe2e82402 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.760957 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-3aa50cb4-222f-471e-868c-a0bfe2e82402 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] HTTP exception thrown: Invalid volume: volume 69ca6413-ed76-423e-a5ff-2aa36241d555 is already attached to instances: 4efb80e9-e2d4-416d-ad9d-3957beb33d56 Aug 13 04:31:42.761978 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3aa50cb4-222f-471e-868c-a0bfe2e82402 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Returning 400 to user: Invalid volume: volume 69ca6413-ed76-423e-a5ff-2aa36241d555 is already attached to instances: 4efb80e9-e2d4-416d-ad9d-3957beb33d56 {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:31:42.762870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3aa50cb4-222f-471e-868c-a0bfe2e82402 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "POST /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101511 Aug 13 04:31:42.763633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 193/367] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:31:42 2021] POST /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Aug 13 04:31:42.844181 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a43d6490-a9ae-4fd6-9fe6-ca877c965ed8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:42.844960 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a43d6490-a9ae-4fd6-9fe6-ca877c965ed8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:42.851826 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a43d6490-a9ae-4fd6-9fe6-ca877c965ed8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.854059 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a43d6490-a9ae-4fd6-9fe6-ca877c965ed8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.855820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a43d6490-a9ae-4fd6-9fe6-ca877c965ed8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.856331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a43d6490-a9ae-4fd6-9fe6-ca877c965ed8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.870511 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-2aec90a7-dd88-4ac8-a979-9ca64012f2a0 req-c1b7bd34-27fd-477b-9d66-d423ed4efb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "74a9fc4b-ae75-488e-94da-6ad5a1a8209c", "tag": "49a37a5c-838a-40d8-aa0d-3456e70554d7"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:42.872164 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:42.872164 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:31:42.895276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-2aec90a7-dd88-4ac8-a979-9ca64012f2a0 req-c1b7bd34-27fd-477b-9d66-d423ed4efb1d service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:42.895872 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-2aec90a7-dd88-4ac8-a979-9ca64012f2a0 req-c1b7bd34-27fd-477b-9d66-d423ed4efb1d service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:42.908289 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-2aec90a7-dd88-4ac8-a979-9ca64012f2a0 req-c1b7bd34-27fd-477b-9d66-d423ed4efb1d service nova] Creating event network-changed:49a37a5c-838a-40d8-aa0d-3456e70554d7 for instance 74a9fc4b-ae75-488e-94da-6ad5a1a8209c on hv-cinder-75996 Aug 13 04:31:42.915486 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-2aec90a7-dd88-4ac8-a979-9ca64012f2a0 req-c1b7bd34-27fd-477b-9d66-d423ed4efb1d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047575 Aug 13 04:31:42.916368 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 194/368] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:42 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:43.053300 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-a43d6490-a9ae-4fd6-9fe6-ca877c965ed8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lazy-loading 'services' on Instance uuid 4efb80e9-e2d4-416d-ad9d-3957beb33d56 {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:31:43.056975 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-82afd531-9488-4e2f-8d05-6bb691ebf9c2 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:43.057864 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-82afd531-9488-4e2f-8d05-6bb691ebf9c2 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:43.064410 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-82afd531-9488-4e2f-8d05-6bb691ebf9c2 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:43.064858 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-82afd531-9488-4e2f-8d05-6bb691ebf9c2 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:43.065661 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-82afd531-9488-4e2f-8d05-6bb691ebf9c2 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:43.066087 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-82afd531-9488-4e2f-8d05-6bb691ebf9c2 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:43.150108 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-82afd531-9488-4e2f-8d05-6bb691ebf9c2 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28621 microversion: 2.1 time: 0.097206 Aug 13 04:31:43.151233 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 195/369] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:43 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28621 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:31:43.156637 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bc92d395-1875-4f70-9186-727580873384 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:43.157689 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bc92d395-1875-4f70-9186-727580873384 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:43.165544 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bc92d395-1875-4f70-9186-727580873384 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:43.166239 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bc92d395-1875-4f70-9186-727580873384 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:43.168519 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bc92d395-1875-4f70-9186-727580873384 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:43.169148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bc92d395-1875-4f70-9186-727580873384 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:43.201929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a43d6490-a9ae-4fd6-9fe6-ca877c965ed8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments/69ca6413-ed76-423e-a5ff-2aa36241d555" status: 202 len: 0 microversion: 2.1 time: 0.361579 Aug 13 04:31:43.203263 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 175/370] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:31:42 2021] DELETE /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments/69ca6413-ed76-423e-a5ff-2aa36241d555 => generated 0 bytes in 364 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:43.213485 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-430c28d7-7831-4aa9-a86e-25a12bfb4801 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:43.215274 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-430c28d7-7831-4aa9-a86e-25a12bfb4801 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:43.225001 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-430c28d7-7831-4aa9-a86e-25a12bfb4801 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:43.225708 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-430c28d7-7831-4aa9-a86e-25a12bfb4801 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:43.226896 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-430c28d7-7831-4aa9-a86e-25a12bfb4801 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:43.227414 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-430c28d7-7831-4aa9-a86e-25a12bfb4801 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:43.269179 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-430c28d7-7831-4aa9-a86e-25a12bfb4801 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.060482 Aug 13 04:31:43.270132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 176/371] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:31:43 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments => generated 197 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:31:43.274197 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bc92d395-1875-4f70-9186-727580873384 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28609 microversion: 2.20 time: 0.121400 Aug 13 04:31:43.274869 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 196/372] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:43 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28609 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:43.430756 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-fe09002f-4801-47ac-923a-b9f35f03d51f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:43.431476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-fe09002f-4801-47ac-923a-b9f35f03d51f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:43.437268 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fe09002f-4801-47ac-923a-b9f35f03d51f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:43.437963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fe09002f-4801-47ac-923a-b9f35f03d51f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:43.438902 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fe09002f-4801-47ac-923a-b9f35f03d51f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:43.439654 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fe09002f-4801-47ac-923a-b9f35f03d51f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:43.458810 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b543c764-89c2-4e49-a3a5-651a04b43e47 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:43.459524 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b543c764-89c2-4e49-a3a5-651a04b43e47 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:43.466151 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b543c764-89c2-4e49-a3a5-651a04b43e47 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:43.466608 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b543c764-89c2-4e49-a3a5-651a04b43e47 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:43.467375 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b543c764-89c2-4e49-a3a5-651a04b43e47 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:43.467813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b543c764-89c2-4e49-a3a5-651a04b43e47 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.006896 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-fe09002f-4801-47ac-923a-b9f35f03d51f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:44.014982 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-fe09002f-4801-47ac-923a-b9f35f03d51f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1515 microversion: 2.1 time: 0.588498 Aug 13 04:31:44.015650 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 177/373] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:43 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1515 bytes in 590 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:44.033825 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b543c764-89c2-4e49-a3a5-651a04b43e47 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:44.039092 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-34509c03-286c-49c5-bc56-9e50ca165a2d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:44.040812 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-34509c03-286c-49c5-bc56-9e50ca165a2d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:44.042183 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b543c764-89c2-4e49-a3a5-651a04b43e47 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1313 microversion: 2.1 time: 0.590043 Aug 13 04:31:44.042850 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 197/374] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:43 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1313 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:44.051472 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34509c03-286c-49c5-bc56-9e50ca165a2d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:44.052288 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34509c03-286c-49c5-bc56-9e50ca165a2d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.053726 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34509c03-286c-49c5-bc56-9e50ca165a2d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:44.054528 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34509c03-286c-49c5-bc56-9e50ca165a2d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.086952 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-34509c03-286c-49c5-bc56-9e50ca165a2d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lazy-loading 'flavor' on Instance uuid 9406e71a-2f8b-48ac-81a4-333ecc986171 {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:31:44.164698 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-072afec8-e6ee-4d51-b180-3dcbbee20638 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:44.170177 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-072afec8-e6ee-4d51-b180-3dcbbee20638 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:44.182225 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-072afec8-e6ee-4d51-b180-3dcbbee20638 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:44.183055 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-072afec8-e6ee-4d51-b180-3dcbbee20638 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.183944 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-072afec8-e6ee-4d51-b180-3dcbbee20638 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:44.184678 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-072afec8-e6ee-4d51-b180-3dcbbee20638 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.290100 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-072afec8-e6ee-4d51-b180-3dcbbee20638 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28621 microversion: 2.1 time: 0.130846 Aug 13 04:31:44.291423 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 198/375] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:44 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28621 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:44.298765 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5f233cf4-a9bd-4cc4-a7c1-92b1b559ffe1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:44.299960 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5f233cf4-a9bd-4cc4-a7c1-92b1b559ffe1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:44.307779 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5f233cf4-a9bd-4cc4-a7c1-92b1b559ffe1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:44.308481 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5f233cf4-a9bd-4cc4-a7c1-92b1b559ffe1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.309408 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5f233cf4-a9bd-4cc4-a7c1-92b1b559ffe1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:44.310498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5f233cf4-a9bd-4cc4-a7c1-92b1b559ffe1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.352744 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5f233cf4-a9bd-4cc4-a7c1-92b1b559ffe1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059533 Aug 13 04:31:44.353331 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 199/376] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:31:44 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:44.358135 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-eae8b2cd-615f-4b5d-a81a-b083205a801e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:44.358816 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-34509c03-286c-49c5-bc56-9e50ca165a2d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "POST /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171/action" status: 200 len: 32 microversion: 2.1 time: 0.328354 Aug 13 04:31:44.359171 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-eae8b2cd-615f-4b5d-a81a-b083205a801e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:44.359993 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 178/377] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:44 2021] POST /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171/action => generated 32 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:31:44.365760 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eae8b2cd-615f-4b5d-a81a-b083205a801e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:44.366342 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eae8b2cd-615f-4b5d-a81a-b083205a801e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.367546 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eae8b2cd-615f-4b5d-a81a-b083205a801e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:44.368018 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eae8b2cd-615f-4b5d-a81a-b083205a801e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.369738 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0fe4d83b-9bcb-407f-b92f-fd7ae1ee9e0c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:44.370570 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0fe4d83b-9bcb-407f-b92f-fd7ae1ee9e0c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:44.379972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0fe4d83b-9bcb-407f-b92f-fd7ae1ee9e0c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:44.380653 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0fe4d83b-9bcb-407f-b92f-fd7ae1ee9e0c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.382998 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0fe4d83b-9bcb-407f-b92f-fd7ae1ee9e0c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:44.384025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0fe4d83b-9bcb-407f-b92f-fd7ae1ee9e0c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:44.456552 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-eae8b2cd-615f-4b5d-a81a-b083205a801e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 28609 microversion: 2.20 time: 0.101929 Aug 13 04:31:44.457625 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 200/378] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:44 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 28609 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:44.676241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0fe4d83b-9bcb-407f-b92f-fd7ae1ee9e0c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:44.688364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0fe4d83b-9bcb-407f-b92f-fd7ae1ee9e0c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.323125 Aug 13 04:31:44.690066 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 179/379] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:44 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:45.076098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c3a893eb-49a3-43e3-b9b8-28f24b65fe0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:45.080387 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c3a893eb-49a3-43e3-b9b8-28f24b65fe0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:45.090343 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3a893eb-49a3-43e3-b9b8-28f24b65fe0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:45.091054 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3a893eb-49a3-43e3-b9b8-28f24b65fe0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:45.092105 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3a893eb-49a3-43e3-b9b8-28f24b65fe0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:45.092965 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3a893eb-49a3-43e3-b9b8-28f24b65fe0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:45.263538 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c3a893eb-49a3-43e3-b9b8-28f24b65fe0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:45.271747 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c3a893eb-49a3-43e3-b9b8-28f24b65fe0c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1313 microversion: 2.1 time: 0.207111 Aug 13 04:31:45.272305 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 201/380] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:45 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:45.301752 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d0cb73b3-340e-41bd-a73c-191eb636907e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:45.302898 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d0cb73b3-340e-41bd-a73c-191eb636907e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:45.309509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d0cb73b3-340e-41bd-a73c-191eb636907e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:45.310163 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d0cb73b3-340e-41bd-a73c-191eb636907e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:45.310955 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d0cb73b3-340e-41bd-a73c-191eb636907e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:45.311372 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d0cb73b3-340e-41bd-a73c-191eb636907e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:45.364079 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-aa5bd4cf-31b3-47c4-8ee8-431451d60067 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:45.364979 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-aa5bd4cf-31b3-47c4-8ee8-431451d60067 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:45.371332 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-aa5bd4cf-31b3-47c4-8ee8-431451d60067 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:45.371848 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-aa5bd4cf-31b3-47c4-8ee8-431451d60067 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:45.372620 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-aa5bd4cf-31b3-47c4-8ee8-431451d60067 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:45.373048 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-aa5bd4cf-31b3-47c4-8ee8-431451d60067 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:45.388699 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d0cb73b3-340e-41bd-a73c-191eb636907e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 28733 microversion: 2.1 time: 0.090199 Aug 13 04:31:45.392943 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 180/381] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:45 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 28733 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:45.408234 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-aa5bd4cf-31b3-47c4-8ee8-431451d60067 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047867 Aug 13 04:31:45.408790 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 202/382] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:31:45 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:31:45.468941 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c47d2579-879b-43ac-9fd9-3bdbe38283e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:45.470208 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c47d2579-879b-43ac-9fd9-3bdbe38283e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:45.478152 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c47d2579-879b-43ac-9fd9-3bdbe38283e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:45.478822 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c47d2579-879b-43ac-9fd9-3bdbe38283e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:45.479845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c47d2579-879b-43ac-9fd9-3bdbe38283e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:45.480609 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c47d2579-879b-43ac-9fd9-3bdbe38283e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:45.555482 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c47d2579-879b-43ac-9fd9-3bdbe38283e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 29808 microversion: 2.20 time: 0.090724 Aug 13 04:31:45.556114 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 181/383] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:45 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 29808 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:31:45.706881 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9466bd1b-3452-45c6-b5db-fcb26f0d754c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:45.707483 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9466bd1b-3452-45c6-b5db-fcb26f0d754c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:45.713442 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9466bd1b-3452-45c6-b5db-fcb26f0d754c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:45.714428 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9466bd1b-3452-45c6-b5db-fcb26f0d754c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:45.714720 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9466bd1b-3452-45c6-b5db-fcb26f0d754c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:45.715160 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9466bd1b-3452-45c6-b5db-fcb26f0d754c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:45.894754 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9466bd1b-3452-45c6-b5db-fcb26f0d754c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:45.903186 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9466bd1b-3452-45c6-b5db-fcb26f0d754c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.199943 Aug 13 04:31:45.903762 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 203/384] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:45 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:46.290947 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-76f0e5bf-2d14-4029-92e1-dd6fdb5e3ee6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:46.291679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-76f0e5bf-2d14-4029-92e1-dd6fdb5e3ee6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:46.298205 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-76f0e5bf-2d14-4029-92e1-dd6fdb5e3ee6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:46.298653 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-76f0e5bf-2d14-4029-92e1-dd6fdb5e3ee6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:46.299428 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-76f0e5bf-2d14-4029-92e1-dd6fdb5e3ee6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:46.299863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-76f0e5bf-2d14-4029-92e1-dd6fdb5e3ee6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:46.401552 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e86c5133-d0d1-4d61-927a-a7ded4fa9c98 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:46.403219 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e86c5133-d0d1-4d61-927a-a7ded4fa9c98 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:46.410455 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e86c5133-d0d1-4d61-927a-a7ded4fa9c98 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:46.411306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e86c5133-d0d1-4d61-927a-a7ded4fa9c98 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:46.412270 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e86c5133-d0d1-4d61-927a-a7ded4fa9c98 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:46.412838 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e86c5133-d0d1-4d61-927a-a7ded4fa9c98 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:46.429843 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-76f0e5bf-2d14-4029-92e1-dd6fdb5e3ee6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:46.437654 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-76f0e5bf-2d14-4029-92e1-dd6fdb5e3ee6 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1313 microversion: 2.1 time: 0.151398 Aug 13 04:31:46.438308 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 182/385] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:46 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1313 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:46.451474 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-58bb5edd-d733-4660-8651-f01cc037c6c9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:46.452459 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-58bb5edd-d733-4660-8651-f01cc037c6c9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:46.458441 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58bb5edd-d733-4660-8651-f01cc037c6c9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:46.458890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58bb5edd-d733-4660-8651-f01cc037c6c9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:46.459667 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58bb5edd-d733-4660-8651-f01cc037c6c9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:46.460735 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58bb5edd-d733-4660-8651-f01cc037c6c9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:46.487738 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e86c5133-d0d1-4d61-927a-a7ded4fa9c98 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 29919 microversion: 2.1 time: 0.090619 Aug 13 04:31:46.488467 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 204/386] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:46 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 29919 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:31:46.490732 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-58bb5edd-d733-4660-8651-f01cc037c6c9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051236 Aug 13 04:31:46.491329 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 183/387] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:31:46 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:46.568000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1d29c3b6-a0a2-4ce9-a16e-2617a598095a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:46.569774 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1d29c3b6-a0a2-4ce9-a16e-2617a598095a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:46.578626 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d29c3b6-a0a2-4ce9-a16e-2617a598095a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:46.579333 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d29c3b6-a0a2-4ce9-a16e-2617a598095a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:46.580183 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d29c3b6-a0a2-4ce9-a16e-2617a598095a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:46.580685 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d29c3b6-a0a2-4ce9-a16e-2617a598095a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:46.712932 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1d29c3b6-a0a2-4ce9-a16e-2617a598095a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 31122 microversion: 2.20 time: 0.149290 Aug 13 04:31:46.717412 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 205/388] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:46 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 31122 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:46.920414 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-dab8339c-0c20-4bb4-9d06-c1b9422caf45 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:46.921152 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-dab8339c-0c20-4bb4-9d06-c1b9422caf45 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:46.927087 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dab8339c-0c20-4bb4-9d06-c1b9422caf45 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:46.927689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dab8339c-0c20-4bb4-9d06-c1b9422caf45 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:46.928655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dab8339c-0c20-4bb4-9d06-c1b9422caf45 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:46.929850 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dab8339c-0c20-4bb4-9d06-c1b9422caf45 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:47.072602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dab8339c-0c20-4bb4-9d06-c1b9422caf45 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:47.080220 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dab8339c-0c20-4bb4-9d06-c1b9422caf45 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.163633 Aug 13 04:31:47.080971 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 184/389] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:46 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:47.456007 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d11893fa-29c4-4573-844f-fd79260fd0d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:47.456698 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d11893fa-29c4-4573-844f-fd79260fd0d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:47.463650 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d11893fa-29c4-4573-844f-fd79260fd0d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:47.464087 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d11893fa-29c4-4573-844f-fd79260fd0d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:47.464836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d11893fa-29c4-4573-844f-fd79260fd0d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:47.465255 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d11893fa-29c4-4573-844f-fd79260fd0d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:47.499607 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-eb981959-6968-48c9-a835-8bfaa3e6876a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:47.500649 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-eb981959-6968-48c9-a835-8bfaa3e6876a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:47.507213 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb981959-6968-48c9-a835-8bfaa3e6876a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:47.507213 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb981959-6968-48c9-a835-8bfaa3e6876a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:47.508454 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb981959-6968-48c9-a835-8bfaa3e6876a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:47.508964 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb981959-6968-48c9-a835-8bfaa3e6876a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:47.588180 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-eb981959-6968-48c9-a835-8bfaa3e6876a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 31611 microversion: 2.1 time: 0.092032 Aug 13 04:31:47.588847 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 185/390] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:47 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 31611 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:31:47.592363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d11893fa-29c4-4573-844f-fd79260fd0d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:47.594014 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-44921518-ed28-4b2f-a2fb-91f3929bec17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:47.595010 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-44921518-ed28-4b2f-a2fb-91f3929bec17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:47.599228 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d11893fa-29c4-4573-844f-fd79260fd0d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1313 microversion: 2.1 time: 0.147048 Aug 13 04:31:47.599797 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 206/391] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:47 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1313 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:47.602758 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-44921518-ed28-4b2f-a2fb-91f3929bec17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:47.603217 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-44921518-ed28-4b2f-a2fb-91f3929bec17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:47.603996 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-44921518-ed28-4b2f-a2fb-91f3929bec17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:47.604428 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-44921518-ed28-4b2f-a2fb-91f3929bec17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:47.634906 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-44921518-ed28-4b2f-a2fb-91f3929bec17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044837 Aug 13 04:31:47.635458 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 186/392] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:31:47 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:47.724798 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2496c507-e7c8-4e85-b25a-30b168d61485 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:47.726437 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2496c507-e7c8-4e85-b25a-30b168d61485 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:47.732325 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2496c507-e7c8-4e85-b25a-30b168d61485 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:47.732774 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2496c507-e7c8-4e85-b25a-30b168d61485 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:47.733572 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2496c507-e7c8-4e85-b25a-30b168d61485 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:47.734005 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2496c507-e7c8-4e85-b25a-30b168d61485 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:47.805954 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2496c507-e7c8-4e85-b25a-30b168d61485 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 32200 microversion: 2.20 time: 0.084667 Aug 13 04:31:47.806621 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 207/393] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:47 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 32200 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:48.097705 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8e2b7bf6-27c3-442a-8cc8-96be98889574 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:48.098340 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8e2b7bf6-27c3-442a-8cc8-96be98889574 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:48.104754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8e2b7bf6-27c3-442a-8cc8-96be98889574 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.105211 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8e2b7bf6-27c3-442a-8cc8-96be98889574 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:48.106067 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8e2b7bf6-27c3-442a-8cc8-96be98889574 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.106498 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8e2b7bf6-27c3-442a-8cc8-96be98889574 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:48.156635 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-11e17971-80cc-4c20-b84f-b29a91cb79a3 req-3b86510c-fd0e-4b8f-a7b3-46c93116d1f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a9fc4b-ae75-488e-94da-6ad5a1a8209c", "name": "network-vif-plugged", "status": "completed", "tag": "49a37a5c-838a-40d8-aa0d-3456e70554d7"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:48.158171 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:31:48.158171 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:31:48.173938 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-11e17971-80cc-4c20-b84f-b29a91cb79a3 req-3b86510c-fd0e-4b8f-a7b3-46c93116d1f1 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.174395 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-11e17971-80cc-4c20-b84f-b29a91cb79a3 req-3b86510c-fd0e-4b8f-a7b3-46c93116d1f1 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:48.186001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-11e17971-80cc-4c20-b84f-b29a91cb79a3 req-3b86510c-fd0e-4b8f-a7b3-46c93116d1f1 service nova] Creating event network-vif-plugged:49a37a5c-838a-40d8-aa0d-3456e70554d7 for instance 74a9fc4b-ae75-488e-94da-6ad5a1a8209c on hv-cinder-75996 Aug 13 04:31:48.190733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-11e17971-80cc-4c20-b84f-b29a91cb79a3 req-3b86510c-fd0e-4b8f-a7b3-46c93116d1f1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038042 Aug 13 04:31:48.191343 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 208/394] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:31:48 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:31:48.247885 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8e2b7bf6-27c3-442a-8cc8-96be98889574 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:48.257963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8e2b7bf6-27c3-442a-8cc8-96be98889574 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.163054 Aug 13 04:31:48.259223 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 187/395] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:48 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:48.600193 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2aa0e976-8416-474d-9716-123c753eabfe tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:48.601911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2aa0e976-8416-474d-9716-123c753eabfe tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:48.608118 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2aa0e976-8416-474d-9716-123c753eabfe tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.608571 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2aa0e976-8416-474d-9716-123c753eabfe tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:48.609339 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2aa0e976-8416-474d-9716-123c753eabfe tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.609816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2aa0e976-8416-474d-9716-123c753eabfe tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:48.619197 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0a723c8c-6850-4cc4-a0fa-d8bd55a8c7d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:48.619809 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0a723c8c-6850-4cc4-a0fa-d8bd55a8c7d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:48.626260 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0a723c8c-6850-4cc4-a0fa-d8bd55a8c7d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.626710 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0a723c8c-6850-4cc4-a0fa-d8bd55a8c7d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:48.627527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0a723c8c-6850-4cc4-a0fa-d8bd55a8c7d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.627902 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0a723c8c-6850-4cc4-a0fa-d8bd55a8c7d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:48.685399 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2aa0e976-8416-474d-9716-123c753eabfe tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 32668 microversion: 2.1 time: 0.088998 Aug 13 04:31:48.686060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 209/396] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:48 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 32668 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:48.690947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b1373070-54ec-467b-ac6d-7ed99581c486 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:48.691928 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b1373070-54ec-467b-ac6d-7ed99581c486 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:48.698673 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1373070-54ec-467b-ac6d-7ed99581c486 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.699115 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1373070-54ec-467b-ac6d-7ed99581c486 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:48.699873 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1373070-54ec-467b-ac6d-7ed99581c486 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.700304 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1373070-54ec-467b-ac6d-7ed99581c486 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:48.730100 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b1373070-54ec-467b-ac6d-7ed99581c486 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042893 Aug 13 04:31:48.730652 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 210/397] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:31:48 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:48.751482 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0a723c8c-6850-4cc4-a0fa-d8bd55a8c7d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:48.759362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0a723c8c-6850-4cc4-a0fa-d8bd55a8c7d9 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1313 microversion: 2.1 time: 0.144518 Aug 13 04:31:48.759919 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 188/398] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:48 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1313 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:48.817351 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-400dfbbb-4cf9-4212-b7be-ffd58fab5cbb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:48.818317 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-400dfbbb-4cf9-4212-b7be-ffd58fab5cbb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:48.824602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-400dfbbb-4cf9-4212-b7be-ffd58fab5cbb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.825051 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-400dfbbb-4cf9-4212-b7be-ffd58fab5cbb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:48.825850 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-400dfbbb-4cf9-4212-b7be-ffd58fab5cbb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:48.826288 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-400dfbbb-4cf9-4212-b7be-ffd58fab5cbb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:49.275798 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-242b9ffb-22b2-4f96-ad10-8b8dfb4de2f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:49.276398 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-242b9ffb-22b2-4f96-ad10-8b8dfb4de2f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:49.282252 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-242b9ffb-22b2-4f96-ad10-8b8dfb4de2f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:49.282700 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-242b9ffb-22b2-4f96-ad10-8b8dfb4de2f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:49.283455 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-242b9ffb-22b2-4f96-ad10-8b8dfb4de2f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:49.283878 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-242b9ffb-22b2-4f96-ad10-8b8dfb4de2f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:49.402136 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-242b9ffb-22b2-4f96-ad10-8b8dfb4de2f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:49.409477 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-242b9ffb-22b2-4f96-ad10-8b8dfb4de2f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.138007 Aug 13 04:31:49.410035 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 189/399] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:49 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:49.697973 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1cdafb62-d407-450f-bd1c-a291c14cd5ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:49.698655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1cdafb62-d407-450f-bd1c-a291c14cd5ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:49.704800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1cdafb62-d407-450f-bd1c-a291c14cd5ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:49.705315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1cdafb62-d407-450f-bd1c-a291c14cd5ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:49.706047 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1cdafb62-d407-450f-bd1c-a291c14cd5ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:49.706478 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1cdafb62-d407-450f-bd1c-a291c14cd5ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:52.029005 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-400dfbbb-4cf9-4212-b7be-ffd58fab5cbb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 33032 microversion: 2.20 time: 3.214580 Aug 13 04:31:52.030200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 211/400] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:48 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 33032 bytes in 3217 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:52.034780 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4d27d9af-fd9d-4b69-ab59-89aadd8cd4b4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:52.035767 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4d27d9af-fd9d-4b69-ab59-89aadd8cd4b4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:52.043375 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d27d9af-fd9d-4b69-ab59-89aadd8cd4b4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:52.043853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d27d9af-fd9d-4b69-ab59-89aadd8cd4b4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:52.044632 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d27d9af-fd9d-4b69-ab59-89aadd8cd4b4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:52.045069 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d27d9af-fd9d-4b69-ab59-89aadd8cd4b4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:52.074173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4d27d9af-fd9d-4b69-ab59-89aadd8cd4b4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043239 Aug 13 04:31:52.074735 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 212/401] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:31:52 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:31:52.075836 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1cdafb62-d407-450f-bd1c-a291c14cd5ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 34377 microversion: 2.1 time: 2.382940 Aug 13 04:31:52.076420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 190/402] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:49 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 34377 bytes in 2385 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:31:52.078974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3df9a2fd-6181-4bfc-a757-7485111f262c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:52.079580 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3df9a2fd-6181-4bfc-a757-7485111f262c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:52.082705 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-eb3e86ea-d5d0-4ab6-9fd9-e42aa7c87aba tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:52.083407 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-eb3e86ea-d5d0-4ab6-9fd9-e42aa7c87aba tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:52.085515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3df9a2fd-6181-4bfc-a757-7485111f262c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:52.085969 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3df9a2fd-6181-4bfc-a757-7485111f262c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:52.086744 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3df9a2fd-6181-4bfc-a757-7485111f262c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:52.087177 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3df9a2fd-6181-4bfc-a757-7485111f262c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:52.090642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb3e86ea-d5d0-4ab6-9fd9-e42aa7c87aba tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:52.091149 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb3e86ea-d5d0-4ab6-9fd9-e42aa7c87aba tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:52.091980 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb3e86ea-d5d0-4ab6-9fd9-e42aa7c87aba tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:52.092426 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb3e86ea-d5d0-4ab6-9fd9-e42aa7c87aba tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:52.276238 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3df9a2fd-6181-4bfc-a757-7485111f262c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:52.281615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-eb3e86ea-d5d0-4ab6-9fd9-e42aa7c87aba tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:52.284135 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3df9a2fd-6181-4bfc-a757-7485111f262c tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1313 microversion: 2.1 time: 0.208357 Aug 13 04:31:52.284761 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 213/403] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:52 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1313 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:52.292435 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-eb3e86ea-d5d0-4ab6-9fd9-e42aa7c87aba tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.211097 Aug 13 04:31:52.292435 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 191/404] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:52 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:53.040314 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a6154137-9034-452a-ac34-2bde90853e64 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:53.042727 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a6154137-9034-452a-ac34-2bde90853e64 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:53.051670 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6154137-9034-452a-ac34-2bde90853e64 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.055237 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6154137-9034-452a-ac34-2bde90853e64 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.056076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6154137-9034-452a-ac34-2bde90853e64 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.061785 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6154137-9034-452a-ac34-2bde90853e64 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.085708 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e1eeff23-6597-4056-a1a5-a49a83a80361 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:53.086847 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e1eeff23-6597-4056-a1a5-a49a83a80361 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:53.093580 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e1eeff23-6597-4056-a1a5-a49a83a80361 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.094012 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e1eeff23-6597-4056-a1a5-a49a83a80361 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.094792 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e1eeff23-6597-4056-a1a5-a49a83a80361 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.095360 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e1eeff23-6597-4056-a1a5-a49a83a80361 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.125756 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e1eeff23-6597-4056-a1a5-a49a83a80361 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044358 Aug 13 04:31:53.126218 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 192/405] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:31:53 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 13 04:31:53.130665 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d0eb3a18-cb9a-4b74-a315-0c88f5894a2d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:53.131646 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d0eb3a18-cb9a-4b74-a315-0c88f5894a2d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:53.136142 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a6154137-9034-452a-ac34-2bde90853e64 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 34666 microversion: 2.20 time: 0.099423 Aug 13 04:31:53.136786 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 214/406] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:53 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 34666 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:53.140794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d0eb3a18-cb9a-4b74-a315-0c88f5894a2d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.140794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d0eb3a18-cb9a-4b74-a315-0c88f5894a2d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.140794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d0eb3a18-cb9a-4b74-a315-0c88f5894a2d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.140794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d0eb3a18-cb9a-4b74-a315-0c88f5894a2d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.221420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d0eb3a18-cb9a-4b74-a315-0c88f5894a2d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 34673 microversion: 2.1 time: 0.093962 Aug 13 04:31:53.222784 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 193/407] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:53 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 34673 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:53.292181 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-762031816", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "networks": [{"uuid": "e5a4407b-136d-4505-b628-117c1b1fc3a4"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:53.301631 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3d7d791f-7ca6-4c0c-b452-64f8ffdab222 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:53.302346 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3d7d791f-7ca6-4c0c-b452-64f8ffdab222 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:53.310321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3d7d791f-7ca6-4c0c-b452-64f8ffdab222 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.310775 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3d7d791f-7ca6-4c0c-b452-64f8ffdab222 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.311941 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3d7d791f-7ca6-4c0c-b452-64f8ffdab222 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.312031 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3d7d791f-7ca6-4c0c-b452-64f8ffdab222 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.344519 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] validate_networks() for [('e5a4407b-136d-4505-b628-117c1b1fc3a4', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:31:53.533737 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3d7d791f-7ca6-4c0c-b452-64f8ffdab222 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:53.542369 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3d7d791f-7ca6-4c0c-b452-64f8ffdab222 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1497 microversion: 2.1 time: 0.244808 Aug 13 04:31:53.542954 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 194/408] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:53 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1497 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:31:53.548069 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-cccb0dc5-8886-441b-a107-2a9dee8f19bc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:53.548950 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-cccb0dc5-8886-441b-a107-2a9dee8f19bc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:53.555991 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cccb0dc5-8886-441b-a107-2a9dee8f19bc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.556479 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cccb0dc5-8886-441b-a107-2a9dee8f19bc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.557376 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cccb0dc5-8886-441b-a107-2a9dee8f19bc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.557848 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cccb0dc5-8886-441b-a107-2a9dee8f19bc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.790143 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-cccb0dc5-8886-441b-a107-2a9dee8f19bc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:53.799186 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-cccb0dc5-8886-441b-a107-2a9dee8f19bc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.254903 Aug 13 04:31:53.800130 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 195/409] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:53 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:53.884923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:31:53.886520 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:31:53.886925 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:31:53.887339 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:31:53.887759 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:31:53.897328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.897830 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.898883 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:53.899324 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:53.918547 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Getting quotas for project 44afcd45727640ec80dc17fe4fcf67fb. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:31:53.922906 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Getting quotas for user 1c6fcd7ffd124e7aa7ace34bed7f7423 and project 44afcd45727640ec80dc17fe4fcf67fb. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:31:53.934606 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:31:53.937018 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:31:53.984118 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4811a1f5-14d2-489b-9a5f-83f703bb058f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.697543 Aug 13 04:31:53.984932 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 215/410] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:31:53 2021] POST /compute/v2.1/servers => generated 380 bytes in 699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:31:53.995095 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-32818dc3-2189-4968-9664-fd845b83fc9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:53.995724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-32818dc3-2189-4968-9664-fd845b83fc9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:54.061773 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-32818dc3-2189-4968-9664-fd845b83fc9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:54.068679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-32818dc3-2189-4968-9664-fd845b83fc9b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1217 microversion: 2.1 time: 0.077728 Aug 13 04:31:54.069778 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 196/411] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:53 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:54.148054 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a7987789-ed96-4974-9424-8e003ac4afae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:54.149162 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a7987789-ed96-4974-9424-8e003ac4afae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:54.155883 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7987789-ed96-4974-9424-8e003ac4afae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:54.156527 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7987789-ed96-4974-9424-8e003ac4afae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:54.157313 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7987789-ed96-4974-9424-8e003ac4afae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:54.157787 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7987789-ed96-4974-9424-8e003ac4afae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:54.234178 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-408c91bc-d25f-4822-8738-38403c4fea0a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:54.235163 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-408c91bc-d25f-4822-8738-38403c4fea0a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:54.242433 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-408c91bc-d25f-4822-8738-38403c4fea0a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:54.243081 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-408c91bc-d25f-4822-8738-38403c4fea0a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:54.244595 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-408c91bc-d25f-4822-8738-38403c4fea0a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:54.245152 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-408c91bc-d25f-4822-8738-38403c4fea0a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:57.279470 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a7987789-ed96-4974-9424-8e003ac4afae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 36540 microversion: 2.20 time: 3.134871 Aug 13 04:31:57.284673 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 216/412] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:54 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 36540 bytes in 3137 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:57.285847 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-664d78ee-df45-4eaa-a746-3b57eba8903b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:57.286022 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-408c91bc-d25f-4822-8738-38403c4fea0a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 36388 microversion: 2.1 time: 3.056507 Aug 13 04:31:57.286842 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 197/413] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:54 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 36388 bytes in 3058 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:31:57.286998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-664d78ee-df45-4eaa-a746-3b57eba8903b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:57.292845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-41c368a6-3fdd-4c0c-b023-1208e6317a40 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:57.293809 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-41c368a6-3fdd-4c0c-b023-1208e6317a40 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:57.295561 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-664d78ee-df45-4eaa-a746-3b57eba8903b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:57.296264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-664d78ee-df45-4eaa-a746-3b57eba8903b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:57.297294 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-664d78ee-df45-4eaa-a746-3b57eba8903b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:57.297890 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-664d78ee-df45-4eaa-a746-3b57eba8903b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:57.300175 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-41c368a6-3fdd-4c0c-b023-1208e6317a40 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:57.300606 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-41c368a6-3fdd-4c0c-b023-1208e6317a40 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:57.301569 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-41c368a6-3fdd-4c0c-b023-1208e6317a40 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:57.302004 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-41c368a6-3fdd-4c0c-b023-1208e6317a40 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:57.373707 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-41c368a6-3fdd-4c0c-b023-1208e6317a40 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:57.381112 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-41c368a6-3fdd-4c0c-b023-1208e6317a40 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1221 microversion: 2.1 time: 0.093369 Aug 13 04:31:57.381746 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 198/414] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:57 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1221 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:57.464681 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-664d78ee-df45-4eaa-a746-3b57eba8903b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:57.472051 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-664d78ee-df45-4eaa-a746-3b57eba8903b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.190110 Aug 13 04:31:57.472620 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 217/415] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:57 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:57.913972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-270a86d3-64a0-4533-bc2d-a07e701f5843 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:57.914476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-270a86d3-64a0-4533-bc2d-a07e701f5843 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:57.921354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-270a86d3-64a0-4533-bc2d-a07e701f5843 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:57.921889 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-270a86d3-64a0-4533-bc2d-a07e701f5843 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:57.922837 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-270a86d3-64a0-4533-bc2d-a07e701f5843 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:57.923296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-270a86d3-64a0-4533-bc2d-a07e701f5843 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:57.949778 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-270a86d3-64a0-4533-bc2d-a07e701f5843 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:31:58.026983 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-270a86d3-64a0-4533-bc2d-a07e701f5843 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "DELETE /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 204 len: 0 microversion: 2.1 time: 0.116568 Aug 13 04:31:58.027845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 199/416] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:31:57 2021] DELETE /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:31:58.035980 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4b6fe60c-8dde-4cf5-aff1-eeb91a404b9e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:58.036803 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4b6fe60c-8dde-4cf5-aff1-eeb91a404b9e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:58.044076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4b6fe60c-8dde-4cf5-aff1-eeb91a404b9e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:58.045007 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4b6fe60c-8dde-4cf5-aff1-eeb91a404b9e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:58.045824 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4b6fe60c-8dde-4cf5-aff1-eeb91a404b9e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:58.046361 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4b6fe60c-8dde-4cf5-aff1-eeb91a404b9e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:58.264241 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4b6fe60c-8dde-4cf5-aff1-eeb91a404b9e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:58.271816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4b6fe60c-8dde-4cf5-aff1-eeb91a404b9e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1503 microversion: 2.1 time: 0.240042 Aug 13 04:31:58.272648 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 218/417] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:58 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1503 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:58.292652 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9e9ef04c-0eae-420b-8433-1d3a4140b139 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:58.293673 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9e9ef04c-0eae-420b-8433-1d3a4140b139 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:58.300083 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e9ef04c-0eae-420b-8433-1d3a4140b139 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:58.300521 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e9ef04c-0eae-420b-8433-1d3a4140b139 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:58.301283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e9ef04c-0eae-420b-8433-1d3a4140b139 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:58.301696 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-37774ec2-c88d-4cd6-a840-c915b9099a0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:58.302149 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e9ef04c-0eae-420b-8433-1d3a4140b139 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:58.302892 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-37774ec2-c88d-4cd6-a840-c915b9099a0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:58.310097 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-37774ec2-c88d-4cd6-a840-c915b9099a0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:58.310663 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-37774ec2-c88d-4cd6-a840-c915b9099a0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:58.311567 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-37774ec2-c88d-4cd6-a840-c915b9099a0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:58.312111 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-37774ec2-c88d-4cd6-a840-c915b9099a0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:58.415212 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9e9ef04c-0eae-420b-8433-1d3a4140b139 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 37097 microversion: 2.20 time: 0.126454 Aug 13 04:31:58.415860 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 200/418] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:58 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 37097 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:31:58.421241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-59259623-eee4-4fae-8169-7e6e2bab70bd tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:58.422207 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-59259623-eee4-4fae-8169-7e6e2bab70bd tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:58.425230 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-37774ec2-c88d-4cd6-a840-c915b9099a0d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 36859 microversion: 2.1 time: 0.127510 Aug 13 04:31:58.426063 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 219/419] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:58 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 36859 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:31:58.429283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-59259623-eee4-4fae-8169-7e6e2bab70bd tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:58.429770 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-59259623-eee4-4fae-8169-7e6e2bab70bd tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:58.430750 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-59259623-eee4-4fae-8169-7e6e2bab70bd tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:58.431191 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-59259623-eee4-4fae-8169-7e6e2bab70bd tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:58.490273 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1cd495df-722b-4247-8fdb-42ed8a69856e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:58.491242 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1cd495df-722b-4247-8fdb-42ed8a69856e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:58.499030 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1cd495df-722b-4247-8fdb-42ed8a69856e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:58.499742 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1cd495df-722b-4247-8fdb-42ed8a69856e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:58.500721 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1cd495df-722b-4247-8fdb-42ed8a69856e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:58.501363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1cd495df-722b-4247-8fdb-42ed8a69856e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:58.529391 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-59259623-eee4-4fae-8169-7e6e2bab70bd tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:58.537550 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-59259623-eee4-4fae-8169-7e6e2bab70bd tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1275 microversion: 2.1 time: 0.120249 Aug 13 04:31:58.538782 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 201/420] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:58 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1275 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:58.738486 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1cd495df-722b-4247-8fdb-42ed8a69856e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:58.747835 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1cd495df-722b-4247-8fdb-42ed8a69856e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.261547 Aug 13 04:31:58.748591 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 220/421] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:58 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:59.288961 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-346f345b-836f-41d7-b430-93d5c8d53579 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:31:59.289613 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-346f345b-836f-41d7-b430-93d5c8d53579 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:59.295986 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-346f345b-836f-41d7-b430-93d5c8d53579 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:59.296700 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-346f345b-836f-41d7-b430-93d5c8d53579 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:59.297359 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-346f345b-836f-41d7-b430-93d5c8d53579 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:59.297822 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-346f345b-836f-41d7-b430-93d5c8d53579 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:59.429004 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9cb6dafb-75fc-4977-9c63-783152a10985 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:59.431284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9cb6dafb-75fc-4977-9c63-783152a10985 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:59.439024 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-346f345b-836f-41d7-b430-93d5c8d53579 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:31:59.442202 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9cb6dafb-75fc-4977-9c63-783152a10985 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:59.442940 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9cb6dafb-75fc-4977-9c63-783152a10985 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:59.444223 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9cb6dafb-75fc-4977-9c63-783152a10985 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:59.445140 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9cb6dafb-75fc-4977-9c63-783152a10985 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:59.453163 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-346f345b-836f-41d7-b430-93d5c8d53579 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1503 microversion: 2.1 time: 0.167820 Aug 13 04:31:59.465797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 202/422] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:31:59 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1503 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:31:59.465797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9f3a4672-7e27-43c1-a1af-62e5361f6338 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:31:59.466174 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9f3a4672-7e27-43c1-a1af-62e5361f6338 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:31:59.475027 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9f3a4672-7e27-43c1-a1af-62e5361f6338 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:59.475489 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9f3a4672-7e27-43c1-a1af-62e5361f6338 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:31:59.476376 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9f3a4672-7e27-43c1-a1af-62e5361f6338 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:31:59.476954 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9f3a4672-7e27-43c1-a1af-62e5361f6338 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:02.446290 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9cb6dafb-75fc-4977-9c63-783152a10985 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 38122 microversion: 2.20 time: 3.022244 Aug 13 04:32:02.451306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 221/423] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:31:59 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 38122 bytes in 3028 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:32:02.452820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9f3a4672-7e27-43c1-a1af-62e5361f6338 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 38092 microversion: 2.1 time: 2.997276 Aug 13 04:32:02.457550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7b3926fb-30c6-47d2-858a-58a5d29135b6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:02.458500 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7b3926fb-30c6-47d2-858a-58a5d29135b6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:02.459602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 203/424] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:31:59 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 38092 bytes in 3001 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:32:02.467466 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e46014cb-9d47-4cf4-a972-cd7d710f86be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:02.468490 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e46014cb-9d47-4cf4-a972-cd7d710f86be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:02.468648 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7b3926fb-30c6-47d2-858a-58a5d29135b6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:02.468996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7b3926fb-30c6-47d2-858a-58a5d29135b6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:02.470028 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7b3926fb-30c6-47d2-858a-58a5d29135b6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:02.470606 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7b3926fb-30c6-47d2-858a-58a5d29135b6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:02.477211 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e46014cb-9d47-4cf4-a972-cd7d710f86be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:02.477965 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e46014cb-9d47-4cf4-a972-cd7d710f86be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:02.479641 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e46014cb-9d47-4cf4-a972-cd7d710f86be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:02.480583 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e46014cb-9d47-4cf4-a972-cd7d710f86be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:03.201228 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7b3926fb-30c6-47d2-858a-58a5d29135b6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:03.209725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7b3926fb-30c6-47d2-858a-58a5d29135b6 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.756976 Aug 13 04:32:03.222209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e46014cb-9d47-4cf4-a972-cd7d710f86be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:03.229823 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e46014cb-9d47-4cf4-a972-cd7d710f86be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.768368 Aug 13 04:32:03.230636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 204/426] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:02 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 770 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:03.234156 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 222/426] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:02 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:03.239243 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4cbf2e37-b53b-470d-b7a8-25cf2d2380d2 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:03.240099 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4cbf2e37-b53b-470d-b7a8-25cf2d2380d2 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:03.247011 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4cbf2e37-b53b-470d-b7a8-25cf2d2380d2 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:03.247864 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4cbf2e37-b53b-470d-b7a8-25cf2d2380d2 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:03.249189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4cbf2e37-b53b-470d-b7a8-25cf2d2380d2 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:03.257240 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4cbf2e37-b53b-470d-b7a8-25cf2d2380d2 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:03.458101 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-52810e71-c941-4e54-85d6-41bd70579368 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:03.461245 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-52810e71-c941-4e54-85d6-41bd70579368 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:03.471867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-52810e71-c941-4e54-85d6-41bd70579368 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:03.472328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-52810e71-c941-4e54-85d6-41bd70579368 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:03.476606 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-52810e71-c941-4e54-85d6-41bd70579368 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:03.479504 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-52810e71-c941-4e54-85d6-41bd70579368 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:03.592225 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-52810e71-c941-4e54-85d6-41bd70579368 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 38122 microversion: 2.20 time: 0.136507 Aug 13 04:32:03.593357 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 223/427] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:32:03 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 38122 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:32:03.600514 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-67929847-84f5-4213-947f-2805be09e5b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:03.602339 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-67929847-84f5-4213-947f-2805be09e5b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:03.609854 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-67929847-84f5-4213-947f-2805be09e5b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:03.610658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-67929847-84f5-4213-947f-2805be09e5b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:03.611802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-67929847-84f5-4213-947f-2805be09e5b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:03.612784 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-67929847-84f5-4213-947f-2805be09e5b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:03.625832 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4cbf2e37-b53b-470d-b7a8-25cf2d2380d2 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:03.634367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4cbf2e37-b53b-470d-b7a8-25cf2d2380d2 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1503 microversion: 2.1 time: 0.402820 Aug 13 04:32:03.637306 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 205/428] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:03 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1503 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:03.718211 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-67929847-84f5-4213-947f-2805be09e5b7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 38095 microversion: 2.1 time: 0.121875 Aug 13 04:32:03.723656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 224/429] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:32:03 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 38095 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:32:04.229643 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-968580f9-ce3e-4561-ba3a-23f4fa029609 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:04.230987 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-968580f9-ce3e-4561-ba3a-23f4fa029609 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:04.240254 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-968580f9-ce3e-4561-ba3a-23f4fa029609 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.245302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-968580f9-ce3e-4561-ba3a-23f4fa029609 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:04.246661 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-968580f9-ce3e-4561-ba3a-23f4fa029609 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.247643 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-968580f9-ce3e-4561-ba3a-23f4fa029609 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:04.248484 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-95cc4809-b8be-4cbc-8a8d-8499d7433b74 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:04.249390 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-95cc4809-b8be-4cbc-8a8d-8499d7433b74 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:04.267944 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-95cc4809-b8be-4cbc-8a8d-8499d7433b74 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.268401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-95cc4809-b8be-4cbc-8a8d-8499d7433b74 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:04.269202 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-95cc4809-b8be-4cbc-8a8d-8499d7433b74 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.275328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-95cc4809-b8be-4cbc-8a8d-8499d7433b74 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:04.791761 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-968580f9-ce3e-4561-ba3a-23f4fa029609 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:04.799943 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-968580f9-ce3e-4561-ba3a-23f4fa029609 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.576785 Aug 13 04:32:04.800787 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 206/430] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:04 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 578 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:04.811847 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-56ff9c28-02bf-407e-aef5-4d5f3de76837 req-3275c5ab-0431-4a7f-9f70-177f52785160 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4a362027-7dd0-4360-92f4-9028fd0081e7", "tag": "0657054b-1691-465d-9907-ea9e81ae050a"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:04.813706 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:32:04.813706 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:32:04.821394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-56ff9c28-02bf-407e-aef5-4d5f3de76837 req-3275c5ab-0431-4a7f-9f70-177f52785160 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.821868 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-56ff9c28-02bf-407e-aef5-4d5f3de76837 req-3275c5ab-0431-4a7f-9f70-177f52785160 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:04.830111 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-95cc4809-b8be-4cbc-8a8d-8499d7433b74 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:04.841376 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-95cc4809-b8be-4cbc-8a8d-8499d7433b74 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.597224 Aug 13 04:32:04.842187 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 225/431] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:04 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 599 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:04.851527 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-09b60073-9e8d-4ed3-af40-a601dbf0d35c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:04.852453 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-09b60073-9e8d-4ed3-af40-a601dbf0d35c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:04.854673 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-56ff9c28-02bf-407e-aef5-4d5f3de76837 req-3275c5ab-0431-4a7f-9f70-177f52785160 service nova] Creating event network-changed:0657054b-1691-465d-9907-ea9e81ae050a for instance 4a362027-7dd0-4360-92f4-9028fd0081e7 on hv-cinder-75996 Aug 13 04:32:04.864702 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-09b60073-9e8d-4ed3-af40-a601dbf0d35c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.864996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-09b60073-9e8d-4ed3-af40-a601dbf0d35c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:04.865826 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-09b60073-9e8d-4ed3-af40-a601dbf0d35c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.866387 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-09b60073-9e8d-4ed3-af40-a601dbf0d35c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:04.870165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-56ff9c28-02bf-407e-aef5-4d5f3de76837 req-3275c5ab-0431-4a7f-9f70-177f52785160 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.060702 Aug 13 04:32:04.870506 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 207/432] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:32:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:32:04.875582 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0145ae91-44c5-4656-8892-5411fdf6fd2e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:04.876305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0145ae91-44c5-4656-8892-5411fdf6fd2e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:04.903263 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0145ae91-44c5-4656-8892-5411fdf6fd2e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.903737 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0145ae91-44c5-4656-8892-5411fdf6fd2e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:04.904576 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0145ae91-44c5-4656-8892-5411fdf6fd2e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.905035 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0145ae91-44c5-4656-8892-5411fdf6fd2e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:04.967391 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-09b60073-9e8d-4ed3-af40-a601dbf0d35c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 200 len: 38265 microversion: 2.20 time: 0.123685 Aug 13 04:32:04.968219 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 226/433] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:32:04 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 38265 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:32:04.974453 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ebaa9f34-0ac6-4547-8bce-734e7651e8cb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:04.975463 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ebaa9f34-0ac6-4547-8bce-734e7651e8cb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:04.983336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ebaa9f34-0ac6-4547-8bce-734e7651e8cb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.983788 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ebaa9f34-0ac6-4547-8bce-734e7651e8cb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:04.984786 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ebaa9f34-0ac6-4547-8bce-734e7651e8cb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:04.985207 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ebaa9f34-0ac6-4547-8bce-734e7651e8cb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:05.064692 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ebaa9f34-0ac6-4547-8bce-734e7651e8cb tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 200 len: 38221 microversion: 2.1 time: 0.094829 Aug 13 04:32:05.065904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 227/434] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:32:04 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 38221 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:32:05.071543 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bf1fd3c6-ca31-488c-bfa2-e5e6f3ce7252 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:05.072330 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bf1fd3c6-ca31-488c-bfa2-e5e6f3ce7252 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:05.079444 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf1fd3c6-ca31-488c-bfa2-e5e6f3ce7252 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:05.080305 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf1fd3c6-ca31-488c-bfa2-e5e6f3ce7252 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:05.081181 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf1fd3c6-ca31-488c-bfa2-e5e6f3ce7252 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:05.081709 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf1fd3c6-ca31-488c-bfa2-e5e6f3ce7252 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:05.107862 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bf1fd3c6-ca31-488c-bfa2-e5e6f3ce7252 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/ips" status: 200 len: 150 microversion: 2.20 time: 0.040592 Aug 13 04:32:05.108442 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 228/435] 10.222.0.13 () {60 vars in 1289 bytes} [Fri Aug 13 04:32:05 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/ips => generated 150 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:32:05.112600 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e37eab17-8767-4053-b8ad-737b4a6ee527 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:05.113259 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e37eab17-8767-4053-b8ad-737b4a6ee527 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:05.119961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e37eab17-8767-4053-b8ad-737b4a6ee527 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:05.120773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e37eab17-8767-4053-b8ad-737b4a6ee527 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:05.121211 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e37eab17-8767-4053-b8ad-737b4a6ee527 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:05.121821 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e37eab17-8767-4053-b8ad-737b4a6ee527 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:05.146457 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e37eab17-8767-4053-b8ad-737b4a6ee527 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/ips" status: 200 len: 144 microversion: 2.1 time: 0.036766 Aug 13 04:32:05.147111 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 229/436] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Aug 13 04:32:05 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/ips => generated 144 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:32:05.540278 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0145ae91-44c5-4656-8892-5411fdf6fd2e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:05.550669 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0145ae91-44c5-4656-8892-5411fdf6fd2e tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1503 microversion: 2.1 time: 0.678875 Aug 13 04:32:05.551257 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 208/437] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:04 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1503 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:05.819061 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5c55cebe-fbfd-4084-a0a8-831341586b04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:05.820087 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5c55cebe-fbfd-4084-a0a8-831341586b04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:05.826090 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c55cebe-fbfd-4084-a0a8-831341586b04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:05.826546 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c55cebe-fbfd-4084-a0a8-831341586b04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:05.827322 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c55cebe-fbfd-4084-a0a8-831341586b04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:05.827758 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5c55cebe-fbfd-4084-a0a8-831341586b04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:05.860791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8f69ea06-1b3b-4355-983d-d9f150e6e9ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:05.861648 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8f69ea06-1b3b-4355-983d-d9f150e6e9ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:05.875498 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8f69ea06-1b3b-4355-983d-d9f150e6e9ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:05.876372 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8f69ea06-1b3b-4355-983d-d9f150e6e9ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:05.877628 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8f69ea06-1b3b-4355-983d-d9f150e6e9ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:05.878324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8f69ea06-1b3b-4355-983d-d9f150e6e9ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:06.383947 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8f69ea06-1b3b-4355-983d-d9f150e6e9ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:06.395596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8f69ea06-1b3b-4355-983d-d9f150e6e9ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.539936 Aug 13 04:32:06.396488 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 209/438] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:05 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:06.438001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5c55cebe-fbfd-4084-a0a8-831341586b04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:06.448490 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5c55cebe-fbfd-4084-a0a8-831341586b04 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.633268 Aug 13 04:32:06.449075 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 230/439] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:05 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 635 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:06.569719 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:06.570717 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:06.581579 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:06.582072 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:06.583704 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:06.584260 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:06.630977 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:06.631689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:06.633953 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lazy-loading 'fault' on Instance uuid 74a9fc4b-ae75-488e-94da-6ad5a1a8209c {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:32:06.718698 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4921641e77d841e98ecc91f020df4251', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'af89c6f3ec974defb8233cfefa31e914', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:06.737045 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1e3cb5a5-95f2-4129-a69e-50a37a64d5df tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 200 len: 1303 microversion: 2.1 time: 0.172785 Aug 13 04:32:06.738145 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 210/440] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:06 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 1303 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:06.912680 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-4f93e077-4d69-491c-8a16-c08af91975a6 req-2450781e-6c22-4384-9e94-fdcec416713e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "74a9fc4b-ae75-488e-94da-6ad5a1a8209c", "name": "network-vif-deleted", "tag": "49a37a5c-838a-40d8-aa0d-3456e70554d7"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:06.915095 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:32:06.915095 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:32:06.923642 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-4f93e077-4d69-491c-8a16-c08af91975a6 req-2450781e-6c22-4384-9e94-fdcec416713e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:06.924461 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-4f93e077-4d69-491c-8a16-c08af91975a6 req-2450781e-6c22-4384-9e94-fdcec416713e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:06.939984 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-4f93e077-4d69-491c-8a16-c08af91975a6 req-2450781e-6c22-4384-9e94-fdcec416713e service nova] Creating event network-vif-deleted:49a37a5c-838a-40d8-aa0d-3456e70554d7 for instance 74a9fc4b-ae75-488e-94da-6ad5a1a8209c on hv-cinder-75996 Aug 13 04:32:06.946168 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-4f93e077-4d69-491c-8a16-c08af91975a6 req-2450781e-6c22-4384-9e94-fdcec416713e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038418 Aug 13 04:32:06.948165 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 231/441] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:32:06 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:32:07.414002 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9ab89299-f071-43c5-9118-0f46661af5ec tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:07.414691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9ab89299-f071-43c5-9118-0f46661af5ec tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:07.421936 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ab89299-f071-43c5-9118-0f46661af5ec tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:07.423139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ab89299-f071-43c5-9118-0f46661af5ec tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:07.424158 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ab89299-f071-43c5-9118-0f46661af5ec tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:07.425456 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ab89299-f071-43c5-9118-0f46661af5ec tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:07.485881 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d36ef8b0-eac1-4581-8939-6e16593fc1b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:07.489760 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d36ef8b0-eac1-4581-8939-6e16593fc1b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:07.496720 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d36ef8b0-eac1-4581-8939-6e16593fc1b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:07.497405 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d36ef8b0-eac1-4581-8939-6e16593fc1b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:07.498381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d36ef8b0-eac1-4581-8939-6e16593fc1b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:07.499032 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d36ef8b0-eac1-4581-8939-6e16593fc1b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:08.015747 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9ab89299-f071-43c5-9118-0f46661af5ec tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:08.025143 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9ab89299-f071-43c5-9118-0f46661af5ec tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.614605 Aug 13 04:32:08.052021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 211/442] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:07 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 642 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:08.072113 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-433329df-25d2-428f-bffa-f469f7a2b64a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:08.072729 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-433329df-25d2-428f-bffa-f469f7a2b64a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:08.083085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-433329df-25d2-428f-bffa-f469f7a2b64a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:08.083534 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-433329df-25d2-428f-bffa-f469f7a2b64a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:08.086603 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-433329df-25d2-428f-bffa-f469f7a2b64a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:08.087062 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-433329df-25d2-428f-bffa-f469f7a2b64a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:08.138640 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-433329df-25d2-428f-bffa-f469f7a2b64a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lazy-loading 'flavor' on Instance uuid d299e5c1-cd60-4057-93a3-5d32e1908d2f {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:32:08.170250 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d36ef8b0-eac1-4581-8939-6e16593fc1b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:08.182185 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d36ef8b0-eac1-4581-8939-6e16593fc1b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.713229 Aug 13 04:32:08.184829 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 232/443] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:07 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:08.189552 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a48ed255-9050-46be-aff5-7c65a43c8728 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:08.195208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a48ed255-9050-46be-aff5-7c65a43c8728 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] [instance: 74a9fc4b-ae75-488e-94da-6ad5a1a8209c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:08.212240 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a48ed255-9050-46be-aff5-7c65a43c8728 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:08.213634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a48ed255-9050-46be-aff5-7c65a43c8728 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:08.216213 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a48ed255-9050-46be-aff5-7c65a43c8728 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:08.217950 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a48ed255-9050-46be-aff5-7c65a43c8728 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:08.234985 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-a48ed255-9050-46be-aff5-7c65a43c8728 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] HTTP exception thrown: Instance 74a9fc4b-ae75-488e-94da-6ad5a1a8209c could not be found. Aug 13 04:32:08.235588 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a48ed255-9050-46be-aff5-7c65a43c8728 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] Returning 404 to user: Instance 74a9fc4b-ae75-488e-94da-6ad5a1a8209c could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:32:08.247646 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a48ed255-9050-46be-aff5-7c65a43c8728 tempest-VolumesActionsTest-836470445 tempest-VolumesActionsTest-836470445-project] 10.222.0.13 "GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c" status: 404 len: 111 microversion: 2.1 time: 0.050438 Aug 13 04:32:08.248275 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 233/444] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:08 2021] GET /compute/v2.1/servers/74a9fc4b-ae75-488e-94da-6ad5a1a8209c => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:32:08.471363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d917e435-8901-470e-af41-e05a4df4b4b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4dd9d1fb-386c-41c8-aea5-a5488efa68f5"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:08.472564 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d917e435-8901-470e-af41-e05a4df4b4b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:08.483197 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d917e435-8901-470e-af41-e05a4df4b4b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:08.483652 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d917e435-8901-470e-af41-e05a4df4b4b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:08.488857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d917e435-8901-470e-af41-e05a4df4b4b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:08.489600 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d917e435-8901-470e-af41-e05a4df4b4b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:08.647511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-433329df-25d2-428f-bffa-f469f7a2b64a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 202 len: 0 microversion: 2.20 time: 0.593707 Aug 13 04:32:08.648737 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 212/445] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:32:08 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 0 bytes in 596 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:32:08.658172 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ef1b74d9-3af3-41ca-9a26-e784bc24ebf3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:08.659931 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ef1b74d9-3af3-41ca-9a26-e784bc24ebf3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:08.673714 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ef1b74d9-3af3-41ca-9a26-e784bc24ebf3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:08.674380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ef1b74d9-3af3-41ca-9a26-e784bc24ebf3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:08.675345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ef1b74d9-3af3-41ca-9a26-e784bc24ebf3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:08.676156 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ef1b74d9-3af3-41ca-9a26-e784bc24ebf3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:09.061594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ef1b74d9-3af3-41ca-9a26-e784bc24ebf3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:09.072523 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ef1b74d9-3af3-41ca-9a26-e784bc24ebf3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:09.074488 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ef1b74d9-3af3-41ca-9a26-e784bc24ebf3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:09.077386 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ef1b74d9-3af3-41ca-9a26-e784bc24ebf3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.423918 Aug 13 04:32:09.078353 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 213/446] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:08 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:09.083480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-04afa6a4-d080-49a2-9330-a8e2772ac7c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:09.084590 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-04afa6a4-d080-49a2-9330-a8e2772ac7c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:09.092133 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04afa6a4-d080-49a2-9330-a8e2772ac7c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:09.095636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04afa6a4-d080-49a2-9330-a8e2772ac7c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:09.097227 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04afa6a4-d080-49a2-9330-a8e2772ac7c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:09.097849 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04afa6a4-d080-49a2-9330-a8e2772ac7c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:09.288818 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-04afa6a4-d080-49a2-9330-a8e2772ac7c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:09.298224 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-04afa6a4-d080-49a2-9330-a8e2772ac7c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.218076 Aug 13 04:32:09.298953 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 214/447] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:09 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:09.304402 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8069ba02-d4e6-4b9e-bd1a-8832238ed30e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:09.305154 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8069ba02-d4e6-4b9e-bd1a-8832238ed30e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:09.312698 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8069ba02-d4e6-4b9e-bd1a-8832238ed30e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:09.313572 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8069ba02-d4e6-4b9e-bd1a-8832238ed30e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:09.314674 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8069ba02-d4e6-4b9e-bd1a-8832238ed30e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:09.315417 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8069ba02-d4e6-4b9e-bd1a-8832238ed30e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:09.473280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8069ba02-d4e6-4b9e-bd1a-8832238ed30e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:09.482844 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8069ba02-d4e6-4b9e-bd1a-8832238ed30e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.182637 Aug 13 04:32:09.483459 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 215/448] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:09 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:10.101339 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3129b8c6-579c-4ca3-a797-be5c08391b77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:10.103159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3129b8c6-579c-4ca3-a797-be5c08391b77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:10.112297 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3129b8c6-579c-4ca3-a797-be5c08391b77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:10.113486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3129b8c6-579c-4ca3-a797-be5c08391b77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:10.114610 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3129b8c6-579c-4ca3-a797-be5c08391b77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:10.115354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3129b8c6-579c-4ca3-a797-be5c08391b77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:10.366311 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3129b8c6-579c-4ca3-a797-be5c08391b77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:10.379606 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3129b8c6-579c-4ca3-a797-be5c08391b77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:10.381385 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3129b8c6-579c-4ca3-a797-be5c08391b77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:10.382826 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3129b8c6-579c-4ca3-a797-be5c08391b77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.289561 Aug 13 04:32:10.383871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 216/449] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:10 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:10.390253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-20e6167d-3e88-4def-91c4-f60310560872 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:10.391116 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-20e6167d-3e88-4def-91c4-f60310560872 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:10.398141 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20e6167d-3e88-4def-91c4-f60310560872 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:10.398865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20e6167d-3e88-4def-91c4-f60310560872 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:10.400071 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20e6167d-3e88-4def-91c4-f60310560872 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:10.401282 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20e6167d-3e88-4def-91c4-f60310560872 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:10.551210 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-20e6167d-3e88-4def-91c4-f60310560872 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:10.559131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-20e6167d-3e88-4def-91c4-f60310560872 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.173027 Aug 13 04:32:10.559703 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 217/450] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:10 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:10.564647 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7a3a8521-a31d-4924-9693-61f99bce3397 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:10.565544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7a3a8521-a31d-4924-9693-61f99bce3397 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:10.572425 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a3a8521-a31d-4924-9693-61f99bce3397 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:10.572869 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a3a8521-a31d-4924-9693-61f99bce3397 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:10.573667 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a3a8521-a31d-4924-9693-61f99bce3397 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:10.574100 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a3a8521-a31d-4924-9693-61f99bce3397 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:10.730276 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7a3a8521-a31d-4924-9693-61f99bce3397 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:10.738573 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7a3a8521-a31d-4924-9693-61f99bce3397 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.177670 Aug 13 04:32:10.739157 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 218/451] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:10 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:11.403881 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6bf0f143-b108-4c86-a36d-204336ddc5a6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:11.404682 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6bf0f143-b108-4c86-a36d-204336ddc5a6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:11.412920 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6bf0f143-b108-4c86-a36d-204336ddc5a6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:11.414025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6bf0f143-b108-4c86-a36d-204336ddc5a6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:11.415055 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6bf0f143-b108-4c86-a36d-204336ddc5a6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:11.415811 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6bf0f143-b108-4c86-a36d-204336ddc5a6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:11.620267 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d917e435-8901-470e-af41-e05a4df4b4b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.152390 Aug 13 04:32:11.626156 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 234/452] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:32:08 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/os-volume_attachments => generated 194 bytes in 3159 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:32:11.644121 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-69a63dd5-2193-465e-a9ee-4dbae1b93e1d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:11.647450 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-69a63dd5-2193-465e-a9ee-4dbae1b93e1d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:11.670214 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-69a63dd5-2193-465e-a9ee-4dbae1b93e1d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:11.671147 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-69a63dd5-2193-465e-a9ee-4dbae1b93e1d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:11.672241 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-69a63dd5-2193-465e-a9ee-4dbae1b93e1d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:11.672893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-69a63dd5-2193-465e-a9ee-4dbae1b93e1d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:12.014852 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6bf0f143-b108-4c86-a36d-204336ddc5a6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:12.026210 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6bf0f143-b108-4c86-a36d-204336ddc5a6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:12.031110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6bf0f143-b108-4c86-a36d-204336ddc5a6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:12.032919 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6bf0f143-b108-4c86-a36d-204336ddc5a6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.635694 Aug 13 04:32:12.061936 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-69a63dd5-2193-465e-a9ee-4dbae1b93e1d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:12.063652 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 219/453] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:11 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:32:12.075103 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9deda432-5fda-4bac-a7e7-a496d4775416 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:12.075728 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9deda432-5fda-4bac-a7e7-a496d4775416 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:12.081867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-69a63dd5-2193-465e-a9ee-4dbae1b93e1d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.448792 Aug 13 04:32:12.085882 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 235/454] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:11 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:12.089950 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9deda432-5fda-4bac-a7e7-a496d4775416 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:12.090356 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9deda432-5fda-4bac-a7e7-a496d4775416 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:12.091155 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9deda432-5fda-4bac-a7e7-a496d4775416 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:12.091602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9deda432-5fda-4bac-a7e7-a496d4775416 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:12.336557 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9deda432-5fda-4bac-a7e7-a496d4775416 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:12.346451 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9deda432-5fda-4bac-a7e7-a496d4775416 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.281776 Aug 13 04:32:12.347493 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 220/455] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:12 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:13.053546 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-cba6c57c-84f4-4822-95ab-24bec967e9dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:13.054315 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-cba6c57c-84f4-4822-95ab-24bec967e9dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:13.063860 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cba6c57c-84f4-4822-95ab-24bec967e9dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:13.067656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cba6c57c-84f4-4822-95ab-24bec967e9dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:13.069321 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cba6c57c-84f4-4822-95ab-24bec967e9dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:13.070143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cba6c57c-84f4-4822-95ab-24bec967e9dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:13.106214 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-793584b1-e9da-4b76-9b6c-ee78105588ea tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:13.106838 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-793584b1-e9da-4b76-9b6c-ee78105588ea tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:13.116248 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-793584b1-e9da-4b76-9b6c-ee78105588ea tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:13.126267 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-793584b1-e9da-4b76-9b6c-ee78105588ea tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:13.127418 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-793584b1-e9da-4b76-9b6c-ee78105588ea tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:13.128025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-793584b1-e9da-4b76-9b6c-ee78105588ea tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:13.698566 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-793584b1-e9da-4b76-9b6c-ee78105588ea tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:13.710845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-793584b1-e9da-4b76-9b6c-ee78105588ea tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.611981 Aug 13 04:32:13.714405 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 221/456] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:13 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:13.718646 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-cba6c57c-84f4-4822-95ab-24bec967e9dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:13.727393 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-cba6c57c-84f4-4822-95ab-24bec967e9dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:13.736237 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-cba6c57c-84f4-4822-95ab-24bec967e9dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:13.737507 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-cba6c57c-84f4-4822-95ab-24bec967e9dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.689102 Aug 13 04:32:13.738081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 236/457] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:13 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 690 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:13.746476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1d948035-6977-4c5d-bbc1-cf6291285009 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:13.750272 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1d948035-6977-4c5d-bbc1-cf6291285009 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:13.761775 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1d948035-6977-4c5d-bbc1-cf6291285009 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:13.762235 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1d948035-6977-4c5d-bbc1-cf6291285009 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:13.766941 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1d948035-6977-4c5d-bbc1-cf6291285009 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:13.767524 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1d948035-6977-4c5d-bbc1-cf6291285009 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:14.080112 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1d948035-6977-4c5d-bbc1-cf6291285009 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:14.091118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1d948035-6977-4c5d-bbc1-cf6291285009 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.362250 Aug 13 04:32:14.092129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 222/458] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:13 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:14.732601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7b2b6d7b-6284-4e8d-8395-21cb3cf3199b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:14.733988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7b2b6d7b-6284-4e8d-8395-21cb3cf3199b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:14.740801 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7b2b6d7b-6284-4e8d-8395-21cb3cf3199b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:14.741412 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7b2b6d7b-6284-4e8d-8395-21cb3cf3199b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:14.742609 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7b2b6d7b-6284-4e8d-8395-21cb3cf3199b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:14.743453 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7b2b6d7b-6284-4e8d-8395-21cb3cf3199b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:14.764125 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-40c7de50-1c36-46a7-b6cf-c39557dc816c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:14.765093 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-40c7de50-1c36-46a7-b6cf-c39557dc816c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:14.780989 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-40c7de50-1c36-46a7-b6cf-c39557dc816c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:14.786544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-40c7de50-1c36-46a7-b6cf-c39557dc816c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:14.789740 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-40c7de50-1c36-46a7-b6cf-c39557dc816c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:14.792409 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-40c7de50-1c36-46a7-b6cf-c39557dc816c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:15.675666 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7b2b6d7b-6284-4e8d-8395-21cb3cf3199b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:15.684527 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7b2b6d7b-6284-4e8d-8395-21cb3cf3199b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.956560 Aug 13 04:32:15.700876 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 237/459] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:14 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 974 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:15.705904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-af3e882c-4857-4263-a15d-57c66a665f72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:15.715192 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-af3e882c-4857-4263-a15d-57c66a665f72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:15.719145 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-40c7de50-1c36-46a7-b6cf-c39557dc816c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:15.729384 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-40c7de50-1c36-46a7-b6cf-c39557dc816c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:15.730948 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-40c7de50-1c36-46a7-b6cf-c39557dc816c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:15.732158 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-40c7de50-1c36-46a7-b6cf-c39557dc816c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.978758 Aug 13 04:32:15.745834 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 223/460] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:14 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 994 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:15.751011 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-af3e882c-4857-4263-a15d-57c66a665f72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:15.751729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-af3e882c-4857-4263-a15d-57c66a665f72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:15.755188 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-af3e882c-4857-4263-a15d-57c66a665f72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:15.755977 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-af3e882c-4857-4263-a15d-57c66a665f72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:16.551303 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-af3e882c-4857-4263-a15d-57c66a665f72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:16.593007 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-af3e882c-4857-4263-a15d-57c66a665f72 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.890540 Aug 13 04:32:16.598537 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 238/461] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:15 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 897 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:16.707392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8fc0f77c-b716-42b2-b535-4b26ffa30c5e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:16.708023 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8fc0f77c-b716-42b2-b535-4b26ffa30c5e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:16.716916 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8fc0f77c-b716-42b2-b535-4b26ffa30c5e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:16.717368 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8fc0f77c-b716-42b2-b535-4b26ffa30c5e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:16.722245 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8fc0f77c-b716-42b2-b535-4b26ffa30c5e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:16.722935 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8fc0f77c-b716-42b2-b535-4b26ffa30c5e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:16.750289 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b17fb401-d0fa-41e5-aee3-86a3d0c6f32a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:16.760849 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b17fb401-d0fa-41e5-aee3-86a3d0c6f32a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:16.789985 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b17fb401-d0fa-41e5-aee3-86a3d0c6f32a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:16.801096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b17fb401-d0fa-41e5-aee3-86a3d0c6f32a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.018s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:16.802029 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b17fb401-d0fa-41e5-aee3-86a3d0c6f32a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:16.802602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b17fb401-d0fa-41e5-aee3-86a3d0c6f32a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:17.684738 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8fc0f77c-b716-42b2-b535-4b26ffa30c5e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:17.693059 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8fc0f77c-b716-42b2-b535-4b26ffa30c5e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.989310 Aug 13 04:32:17.693964 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 224/462] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:16 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 991 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:18.066310 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-09024161-e4fd-4c07-bd50-28b415cb69be tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Action: 'create', calling method: .version_select at 0x7fc46ca149d0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1012993253"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:18.096393 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-09024161-e4fd-4c07-bd50-28b415cb69be tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Getting quotas for project 88885460859447cea3664074daf50abb. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:32:18.107183 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-09024161-e4fd-4c07-bd50-28b415cb69be tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Getting quotas for user 44a59c76c3f141ea83419c098aef1aac and project 88885460859447cea3664074daf50abb. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:32:18.152059 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b17fb401-d0fa-41e5-aee3-86a3d0c6f32a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:18.160897 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b17fb401-d0fa-41e5-aee3-86a3d0c6f32a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:18.170209 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b17fb401-d0fa-41e5-aee3-86a3d0c6f32a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:18.171759 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b17fb401-d0fa-41e5-aee3-86a3d0c6f32a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 1.425186 Aug 13 04:32:18.184091 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 239/463] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:16 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 1438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:18.188933 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ecb8c310-9600-4fd7-940b-af8b62122625 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:18.191770 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ecb8c310-9600-4fd7-940b-af8b62122625 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:18.212983 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ecb8c310-9600-4fd7-940b-af8b62122625 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:18.214053 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ecb8c310-9600-4fd7-940b-af8b62122625 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:18.215153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ecb8c310-9600-4fd7-940b-af8b62122625 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:18.216015 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ecb8c310-9600-4fd7-940b-af8b62122625 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:18.322347 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-09024161-e4fd-4c07-bd50-28b415cb69be tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Getting quotas for project 88885460859447cea3664074daf50abb. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:32:18.328506 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-09024161-e4fd-4c07-bd50-28b415cb69be tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Getting quotas for user 44a59c76c3f141ea83419c098aef1aac and project 88885460859447cea3664074daf50abb. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:32:18.349786 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-09024161-e4fd-4c07-bd50-28b415cb69be tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.647016 Aug 13 04:32:18.356305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 225/464] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Aug 13 04:32:17 2021] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:18.404838 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-8c260ed1-ecf1-46b6-9302-27f7caea7d26 req-d5ace9a2-08ff-4c99-846e-6ad492e38719 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a362027-7dd0-4360-92f4-9028fd0081e7", "name": "network-vif-plugged", "status": "completed", "tag": "0657054b-1691-465d-9907-ea9e81ae050a"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:18.407200 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:32:18.407200 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:32:18.424620 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-8c260ed1-ecf1-46b6-9302-27f7caea7d26 req-d5ace9a2-08ff-4c99-846e-6ad492e38719 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:18.426659 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-8c260ed1-ecf1-46b6-9302-27f7caea7d26 req-d5ace9a2-08ff-4c99-846e-6ad492e38719 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:18.448794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-8c260ed1-ecf1-46b6-9302-27f7caea7d26 req-d5ace9a2-08ff-4c99-846e-6ad492e38719 service nova] Creating event network-vif-plugged:0657054b-1691-465d-9907-ea9e81ae050a for instance 4a362027-7dd0-4360-92f4-9028fd0081e7 on hv-cinder-75996 Aug 13 04:32:18.474962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-8c260ed1-ecf1-46b6-9302-27f7caea7d26 req-d5ace9a2-08ff-4c99-846e-6ad492e38719 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072492 Aug 13 04:32:18.479098 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 226/465] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:32:18 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:32:18.713031 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f8dd3877-3dd5-4571-993a-70a420cb26d3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:18.714325 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f8dd3877-3dd5-4571-993a-70a420cb26d3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:18.739055 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f8dd3877-3dd5-4571-993a-70a420cb26d3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:18.740165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f8dd3877-3dd5-4571-993a-70a420cb26d3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:18.741391 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f8dd3877-3dd5-4571-993a-70a420cb26d3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:18.750340 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f8dd3877-3dd5-4571-993a-70a420cb26d3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:18.896893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ecb8c310-9600-4fd7-940b-af8b62122625 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:18.909390 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ecb8c310-9600-4fd7-940b-af8b62122625 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.723888 Aug 13 04:32:18.925582 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 240/466] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:18 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 741 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:19.195718 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7e940499-89ab-4615-9e4a-bdf57be6fa07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:19.198525 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7e940499-89ab-4615-9e4a-bdf57be6fa07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:19.220348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7e940499-89ab-4615-9e4a-bdf57be6fa07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:19.223231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7e940499-89ab-4615-9e4a-bdf57be6fa07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:19.225399 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7e940499-89ab-4615-9e4a-bdf57be6fa07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:19.233200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7e940499-89ab-4615-9e4a-bdf57be6fa07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:19.645537 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f8dd3877-3dd5-4571-993a-70a420cb26d3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:19.658726 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f8dd3877-3dd5-4571-993a-70a420cb26d3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.951632 Aug 13 04:32:19.660566 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 227/467] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:18 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 954 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:19.932467 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-085baca8-f7d0-42ed-bef3-dcb6d6f72ccf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:19.933675 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-085baca8-f7d0-42ed-bef3-dcb6d6f72ccf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:19.940949 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-085baca8-f7d0-42ed-bef3-dcb6d6f72ccf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:19.954392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-085baca8-f7d0-42ed-bef3-dcb6d6f72ccf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:19.957901 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-085baca8-f7d0-42ed-bef3-dcb6d6f72ccf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:19.960427 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-085baca8-f7d0-42ed-bef3-dcb6d6f72ccf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:20.170655 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7e940499-89ab-4615-9e4a-bdf57be6fa07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:20.182681 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7e940499-89ab-4615-9e4a-bdf57be6fa07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:20.185971 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7e940499-89ab-4615-9e4a-bdf57be6fa07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:20.197973 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7e940499-89ab-4615-9e4a-bdf57be6fa07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 1.010546 Aug 13 04:32:20.206587 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 241/468] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:19 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 1020 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:20.539603 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-085baca8-f7d0-42ed-bef3-dcb6d6f72ccf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:20.554397 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-085baca8-f7d0-42ed-bef3-dcb6d6f72ccf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1317 microversion: 2.1 time: 0.623393 Aug 13 04:32:20.555129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 228/469] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:19 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1317 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:20.678249 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-87e344ef-571e-4081-b371-e182bda64d5c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:20.678913 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-87e344ef-571e-4081-b371-e182bda64d5c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:20.697400 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-87e344ef-571e-4081-b371-e182bda64d5c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:20.698551 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-87e344ef-571e-4081-b371-e182bda64d5c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:20.702201 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-87e344ef-571e-4081-b371-e182bda64d5c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:20.703510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-87e344ef-571e-4081-b371-e182bda64d5c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:20.957887 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-87e344ef-571e-4081-b371-e182bda64d5c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:20.971193 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-87e344ef-571e-4081-b371-e182bda64d5c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.296129 Aug 13 04:32:20.973357 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 242/470] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:20 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:21.224753 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a214e984-71da-4797-90a6-083700925ea2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:21.226079 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a214e984-71da-4797-90a6-083700925ea2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:21.241959 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a214e984-71da-4797-90a6-083700925ea2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:21.247872 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a214e984-71da-4797-90a6-083700925ea2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:21.249511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a214e984-71da-4797-90a6-083700925ea2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:21.249982 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a214e984-71da-4797-90a6-083700925ea2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:21.572522 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ad590976-c83f-4baa-af7c-defac5cbdfc9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:21.574109 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ad590976-c83f-4baa-af7c-defac5cbdfc9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:21.590475 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ad590976-c83f-4baa-af7c-defac5cbdfc9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:21.590711 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a214e984-71da-4797-90a6-083700925ea2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:21.596554 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ad590976-c83f-4baa-af7c-defac5cbdfc9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:21.598189 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ad590976-c83f-4baa-af7c-defac5cbdfc9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:21.601846 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a214e984-71da-4797-90a6-083700925ea2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:21.604245 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a214e984-71da-4797-90a6-083700925ea2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:21.604932 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ad590976-c83f-4baa-af7c-defac5cbdfc9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:21.639254 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a214e984-71da-4797-90a6-083700925ea2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.412668 Aug 13 04:32:21.652930 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 229/471] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:21 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:21.919862 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ad590976-c83f-4baa-af7c-defac5cbdfc9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:21.927773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ad590976-c83f-4baa-af7c-defac5cbdfc9 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1507 microversion: 2.1 time: 0.359958 Aug 13 04:32:21.929802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 243/472] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:21 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1507 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:21.990646 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-aaa832bb-3677-4464-b79c-60eb8733df83 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:21.991501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-aaa832bb-3677-4464-b79c-60eb8733df83 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:22.007798 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aaa832bb-3677-4464-b79c-60eb8733df83 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:22.010832 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aaa832bb-3677-4464-b79c-60eb8733df83 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:22.011890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aaa832bb-3677-4464-b79c-60eb8733df83 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:22.013700 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aaa832bb-3677-4464-b79c-60eb8733df83 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:22.285719 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-aaa832bb-3677-4464-b79c-60eb8733df83 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:22.298700 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-aaa832bb-3677-4464-b79c-60eb8733df83 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.311837 Aug 13 04:32:22.311405 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 230/473] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:21 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:22.670825 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a456c055-1781-4896-81c0-59a6840b5068 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:22.673719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a456c055-1781-4896-81c0-59a6840b5068 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:22.710264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a456c055-1781-4896-81c0-59a6840b5068 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:22.712602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a456c055-1781-4896-81c0-59a6840b5068 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:22.714965 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a456c055-1781-4896-81c0-59a6840b5068 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:22.717489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a456c055-1781-4896-81c0-59a6840b5068 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:23.125666 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a456c055-1781-4896-81c0-59a6840b5068 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:23.134500 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a456c055-1781-4896-81c0-59a6840b5068 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:23.141885 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a456c055-1781-4896-81c0-59a6840b5068 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:23.154521 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a456c055-1781-4896-81c0-59a6840b5068 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.497146 Aug 13 04:32:23.159414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 244/474] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:22 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:23.317675 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1a581613-1ee2-4546-9122-6575209314ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:23.320501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1a581613-1ee2-4546-9122-6575209314ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:23.336377 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a581613-1ee2-4546-9122-6575209314ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:23.338018 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a581613-1ee2-4546-9122-6575209314ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:23.339892 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a581613-1ee2-4546-9122-6575209314ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:23.341092 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a581613-1ee2-4546-9122-6575209314ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:23.504028 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7ff81e8a-b5f2-4993-9f7b-12087426be42 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:23.513980 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7ff81e8a-b5f2-4993-9f7b-12087426be42 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:23.514430 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7ff81e8a-b5f2-4993-9f7b-12087426be42 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:23.618519 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1a581613-1ee2-4546-9122-6575209314ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:23.636794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1a581613-1ee2-4546-9122-6575209314ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.321681 Aug 13 04:32:23.637498 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 231/475] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:23 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:23.688513 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7ff81e8a-b5f2-4993-9f7b-12087426be42 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Going to try to stop instance {{(pid=108288) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 13 04:32:23.794925 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7ff81e8a-b5f2-4993-9f7b-12087426be42 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 202 len: 0 microversion: 2.1 time: 0.293891 Aug 13 04:32:23.795999 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 245/476] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:32:23 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 0 bytes in 296 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:32:23.804755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-80c4e989-81bd-4fb2-9dee-e4e3865847cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:23.805942 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-80c4e989-81bd-4fb2-9dee-e4e3865847cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:23.812625 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-80c4e989-81bd-4fb2-9dee-e4e3865847cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:23.813085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-80c4e989-81bd-4fb2-9dee-e4e3865847cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:23.825815 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-80c4e989-81bd-4fb2-9dee-e4e3865847cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:23.826285 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-80c4e989-81bd-4fb2-9dee-e4e3865847cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:24.095314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-80c4e989-81bd-4fb2-9dee-e4e3865847cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:24.109619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-80c4e989-81bd-4fb2-9dee-e4e3865847cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.308635 Aug 13 04:32:24.121687 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 232/477] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:23 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:24.176953 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d7c7f213-b720-4824-8aa6-39b59652b4ae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:24.178670 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d7c7f213-b720-4824-8aa6-39b59652b4ae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:24.191786 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d7c7f213-b720-4824-8aa6-39b59652b4ae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:24.192915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d7c7f213-b720-4824-8aa6-39b59652b4ae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:24.198224 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d7c7f213-b720-4824-8aa6-39b59652b4ae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:24.198910 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d7c7f213-b720-4824-8aa6-39b59652b4ae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:24.276369 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-09d07773-b032-4ddd-98ba-a950cca81d37 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e082b5d5-a273-4624-a215-5e1b99162653"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:24.278319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-09d07773-b032-4ddd-98ba-a950cca81d37 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:24.288473 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-09d07773-b032-4ddd-98ba-a950cca81d37 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:24.289070 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-09d07773-b032-4ddd-98ba-a950cca81d37 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:24.291463 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-09d07773-b032-4ddd-98ba-a950cca81d37 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:24.292013 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-09d07773-b032-4ddd-98ba-a950cca81d37 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:24.458671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d7c7f213-b720-4824-8aa6-39b59652b4ae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:24.470317 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d7c7f213-b720-4824-8aa6-39b59652b4ae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:24.472211 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d7c7f213-b720-4824-8aa6-39b59652b4ae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:24.473672 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d7c7f213-b720-4824-8aa6-39b59652b4ae tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.300780 Aug 13 04:32:24.474469 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 246/478] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:24 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:24.654859 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ecf69bbb-3c7d-4ee6-b09d-5bfb55838e55 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:24.655827 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ecf69bbb-3c7d-4ee6-b09d-5bfb55838e55 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:24.662601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ecf69bbb-3c7d-4ee6-b09d-5bfb55838e55 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:24.663055 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ecf69bbb-3c7d-4ee6-b09d-5bfb55838e55 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:24.663859 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ecf69bbb-3c7d-4ee6-b09d-5bfb55838e55 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:24.664859 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ecf69bbb-3c7d-4ee6-b09d-5bfb55838e55 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:24.762880 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-09d07773-b032-4ddd-98ba-a950cca81d37 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "POST /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.492578 Aug 13 04:32:24.787487 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 233/479] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:32:24 2021] POST /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7/os-volume_attachments => generated 194 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:32:24.849873 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ecf69bbb-3c7d-4ee6-b09d-5bfb55838e55 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:24.858641 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ecf69bbb-3c7d-4ee6-b09d-5bfb55838e55 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.207998 Aug 13 04:32:24.860176 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 247/480] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:24 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:25.130675 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9a4c41dd-698c-4f80-ac60-b72ed16e1386 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:25.131638 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9a4c41dd-698c-4f80-ac60-b72ed16e1386 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:25.152691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a4c41dd-698c-4f80-ac60-b72ed16e1386 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:25.153156 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a4c41dd-698c-4f80-ac60-b72ed16e1386 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:25.154079 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a4c41dd-698c-4f80-ac60-b72ed16e1386 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:25.154827 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a4c41dd-698c-4f80-ac60-b72ed16e1386 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:25.422762 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9a4c41dd-698c-4f80-ac60-b72ed16e1386 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:25.434402 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9a4c41dd-698c-4f80-ac60-b72ed16e1386 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.309128 Aug 13 04:32:25.436081 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 234/481] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:25 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:25.492972 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-459ee537-5764-468b-b9cc-f02a3676c1e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:25.494852 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-459ee537-5764-468b-b9cc-f02a3676c1e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:25.502339 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-459ee537-5764-468b-b9cc-f02a3676c1e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:25.503081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-459ee537-5764-468b-b9cc-f02a3676c1e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:25.504496 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-459ee537-5764-468b-b9cc-f02a3676c1e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:25.505239 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-459ee537-5764-468b-b9cc-f02a3676c1e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:25.879544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a8037b17-b58e-45d3-8fbb-850ceac5ba11 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:25.880137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a8037b17-b58e-45d3-8fbb-850ceac5ba11 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:25.896904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-459ee537-5764-468b-b9cc-f02a3676c1e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:25.906615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a8037b17-b58e-45d3-8fbb-850ceac5ba11 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:25.917680 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-459ee537-5764-468b-b9cc-f02a3676c1e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:25.921153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-459ee537-5764-468b-b9cc-f02a3676c1e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:25.923913 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-459ee537-5764-468b-b9cc-f02a3676c1e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.435097 Aug 13 04:32:25.924057 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a8037b17-b58e-45d3-8fbb-850ceac5ba11 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:25.926401 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a8037b17-b58e-45d3-8fbb-850ceac5ba11 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:25.927030 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a8037b17-b58e-45d3-8fbb-850ceac5ba11 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:25.938771 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 248/482] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:25 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:26.194316 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a8037b17-b58e-45d3-8fbb-850ceac5ba11 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:26.208606 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a8037b17-b58e-45d3-8fbb-850ceac5ba11 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.330609 Aug 13 04:32:26.210648 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 235/483] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:25 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:26.454032 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c3599c20-f302-4e8a-a7e2-a3692572850d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:26.454978 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c3599c20-f302-4e8a-a7e2-a3692572850d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:26.473151 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3599c20-f302-4e8a-a7e2-a3692572850d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:26.473993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3599c20-f302-4e8a-a7e2-a3692572850d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:26.475010 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3599c20-f302-4e8a-a7e2-a3692572850d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:26.475670 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3599c20-f302-4e8a-a7e2-a3692572850d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:26.777917 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c3599c20-f302-4e8a-a7e2-a3692572850d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:26.786703 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c3599c20-f302-4e8a-a7e2-a3692572850d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.336221 Aug 13 04:32:26.790601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 249/484] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:26 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:26.948684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-180fceb9-99c6-43a7-b8c0-647b92de54f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:26.954355 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-180fceb9-99c6-43a7-b8c0-647b92de54f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:26.993657 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-180fceb9-99c6-43a7-b8c0-647b92de54f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:26.994978 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-180fceb9-99c6-43a7-b8c0-647b92de54f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:26.999821 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-180fceb9-99c6-43a7-b8c0-647b92de54f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:27.004333 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-180fceb9-99c6-43a7-b8c0-647b92de54f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:27.229965 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9bb8af07-7fde-4914-a31d-80eabb80f11c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:27.230639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9bb8af07-7fde-4914-a31d-80eabb80f11c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:27.250447 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9bb8af07-7fde-4914-a31d-80eabb80f11c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:27.251095 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9bb8af07-7fde-4914-a31d-80eabb80f11c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:27.251929 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9bb8af07-7fde-4914-a31d-80eabb80f11c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:27.252549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9bb8af07-7fde-4914-a31d-80eabb80f11c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:28.028179 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-180fceb9-99c6-43a7-b8c0-647b92de54f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:28.038904 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-180fceb9-99c6-43a7-b8c0-647b92de54f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:28.046655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-180fceb9-99c6-43a7-b8c0-647b92de54f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:28.048376 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-180fceb9-99c6-43a7-b8c0-647b92de54f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 1.108012 Aug 13 04:32:28.051440 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 236/485] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:26 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 1112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:28.062611 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-74a5c783-92a6-4503-813b-bb6ade386cb7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:28.063473 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-74a5c783-92a6-4503-813b-bb6ade386cb7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:28.078605 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74a5c783-92a6-4503-813b-bb6ade386cb7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:28.079299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74a5c783-92a6-4503-813b-bb6ade386cb7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:28.081319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74a5c783-92a6-4503-813b-bb6ade386cb7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:28.082074 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74a5c783-92a6-4503-813b-bb6ade386cb7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:28.151348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9bb8af07-7fde-4914-a31d-80eabb80f11c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:28.160394 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9bb8af07-7fde-4914-a31d-80eabb80f11c tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.934822 Aug 13 04:32:28.166545 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 250/486] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:27 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 938 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:28.348986 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-74a5c783-92a6-4503-813b-bb6ade386cb7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:28.361154 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-74a5c783-92a6-4503-813b-bb6ade386cb7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.303106 Aug 13 04:32:28.364809 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 237/487] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:28 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:29.067817 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e423dc1b-725a-491f-9fac-38a656dc1f77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:29.069409 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e423dc1b-725a-491f-9fac-38a656dc1f77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:29.083713 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e423dc1b-725a-491f-9fac-38a656dc1f77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:29.084340 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e423dc1b-725a-491f-9fac-38a656dc1f77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:29.085346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e423dc1b-725a-491f-9fac-38a656dc1f77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:29.089748 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e423dc1b-725a-491f-9fac-38a656dc1f77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:29.178349 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-fc18ba19-8cc4-403f-9067-e1c90f41bb7a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:29.182089 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-fc18ba19-8cc4-403f-9067-e1c90f41bb7a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:29.201922 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fc18ba19-8cc4-403f-9067-e1c90f41bb7a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:29.206488 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fc18ba19-8cc4-403f-9067-e1c90f41bb7a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:29.209117 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fc18ba19-8cc4-403f-9067-e1c90f41bb7a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:29.209777 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fc18ba19-8cc4-403f-9067-e1c90f41bb7a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:29.679724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-fc18ba19-8cc4-403f-9067-e1c90f41bb7a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:29.699039 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e423dc1b-725a-491f-9fac-38a656dc1f77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:29.711248 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e423dc1b-725a-491f-9fac-38a656dc1f77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:29.715609 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e423dc1b-725a-491f-9fac-38a656dc1f77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:29.716416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-fc18ba19-8cc4-403f-9067-e1c90f41bb7a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.540152 Aug 13 04:32:29.717744 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e423dc1b-725a-491f-9fac-38a656dc1f77 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1743 microversion: 2.20 time: 0.653912 Aug 13 04:32:29.729065 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 238/488] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:29 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:29.737534 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 251/489] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:29 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1743 bytes in 667 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:29.737764 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-59749333-8226-4097-8154-ff0b9a4ba2a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:29.740027 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-59749333-8226-4097-8154-ff0b9a4ba2a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:29.770041 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-59749333-8226-4097-8154-ff0b9a4ba2a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:29.773117 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-59749333-8226-4097-8154-ff0b9a4ba2a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:29.781589 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-59749333-8226-4097-8154-ff0b9a4ba2a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:29.784790 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-59749333-8226-4097-8154-ff0b9a4ba2a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:30.573364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-59749333-8226-4097-8154-ff0b9a4ba2a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:30.582195 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-59749333-8226-4097-8154-ff0b9a4ba2a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.851890 Aug 13 04:32:30.583646 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 239/490] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:29 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:30.735690 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-462e3377-703d-4cb2-89f7-c54c416098d2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:30.736379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-462e3377-703d-4cb2-89f7-c54c416098d2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:30.750599 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-deb12eae-d870-42e1-8e45-8d104e2f75f0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:30.751218 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-deb12eae-d870-42e1-8e45-8d104e2f75f0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:30.754871 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-462e3377-703d-4cb2-89f7-c54c416098d2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:30.755403 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-462e3377-703d-4cb2-89f7-c54c416098d2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:30.756237 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-462e3377-703d-4cb2-89f7-c54c416098d2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:30.756670 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-462e3377-703d-4cb2-89f7-c54c416098d2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:30.765041 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-deb12eae-d870-42e1-8e45-8d104e2f75f0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:30.765533 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-deb12eae-d870-42e1-8e45-8d104e2f75f0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:30.766480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-deb12eae-d870-42e1-8e45-8d104e2f75f0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:30.775390 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-deb12eae-d870-42e1-8e45-8d104e2f75f0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:31.200117 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-462e3377-703d-4cb2-89f7-c54c416098d2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:31.211131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-deb12eae-d870-42e1-8e45-8d104e2f75f0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:31.216567 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-462e3377-703d-4cb2-89f7-c54c416098d2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.483314 Aug 13 04:32:31.219534 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-deb12eae-d870-42e1-8e45-8d104e2f75f0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:31.224935 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-deb12eae-d870-42e1-8e45-8d104e2f75f0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:31.230203 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 252/491] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:30 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:31.233655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-deb12eae-d870-42e1-8e45-8d104e2f75f0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.486254 Aug 13 04:32:31.234463 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 240/492] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:30 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 488 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:31.600977 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5b5bf16b-4e30-4af2-a1ec-4dba178b3277 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:31.602988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5b5bf16b-4e30-4af2-a1ec-4dba178b3277 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:31.618704 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5b5bf16b-4e30-4af2-a1ec-4dba178b3277 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:31.624702 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-d7f68793-5eed-4610-87da-9629257870fc req-8dc67c7f-01c9-4f88-be96-3f0c88103b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d299e5c1-cd60-4057-93a3-5d32e1908d2f", "name": "network-vif-plugged", "status": "completed", "tag": "c3be48be-e5ee-48ea-a418-bc6c5c7a337c"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:31.626484 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:32:31.626484 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:32:31.627930 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5b5bf16b-4e30-4af2-a1ec-4dba178b3277 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:31.629223 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5b5bf16b-4e30-4af2-a1ec-4dba178b3277 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:31.630034 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5b5bf16b-4e30-4af2-a1ec-4dba178b3277 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:31.649387 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-d7f68793-5eed-4610-87da-9629257870fc req-8dc67c7f-01c9-4f88-be96-3f0c88103b93 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:31.649987 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-d7f68793-5eed-4610-87da-9629257870fc req-8dc67c7f-01c9-4f88-be96-3f0c88103b93 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:31.682621 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-d7f68793-5eed-4610-87da-9629257870fc req-8dc67c7f-01c9-4f88-be96-3f0c88103b93 service nova] Creating event network-vif-plugged:c3be48be-e5ee-48ea-a418-bc6c5c7a337c for instance d299e5c1-cd60-4057-93a3-5d32e1908d2f on hv-cinder-75996 Aug 13 04:32:31.720369 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-d7f68793-5eed-4610-87da-9629257870fc req-8dc67c7f-01c9-4f88-be96-3f0c88103b93 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099113 Aug 13 04:32:31.722177 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 241/493] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:32:31 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:32:31.989115 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5b5bf16b-4e30-4af2-a1ec-4dba178b3277 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:31.999955 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5b5bf16b-4e30-4af2-a1ec-4dba178b3277 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.402562 Aug 13 04:32:32.006373 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 253/494] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:31 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:32.100788 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2568ad9c-1300-44ab-8178-9aeee56c05d3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Action: 'create', calling method: .version_select at 0x7fc46ea09a60>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1602395338"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:32.153083 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-2568ad9c-1300-44ab-8178-9aeee56c05d3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Getting quotas for project 6f2d284955ea4d12b60ceba4f7a53e87. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:32:32.167435 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-2568ad9c-1300-44ab-8178-9aeee56c05d3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Getting quotas for user 3abce7098260457cad30873156a242d0 and project 6f2d284955ea4d12b60ceba4f7a53e87. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:32:32.234695 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d462fa31-7cff-492d-920c-b851f6577d70 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:32.235312 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d462fa31-7cff-492d-920c-b851f6577d70 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:32.246757 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d462fa31-7cff-492d-920c-b851f6577d70 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:32.248059 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d462fa31-7cff-492d-920c-b851f6577d70 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:32.249677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d462fa31-7cff-492d-920c-b851f6577d70 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:32.250882 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d462fa31-7cff-492d-920c-b851f6577d70 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:32.312743 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-2568ad9c-1300-44ab-8178-9aeee56c05d3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Getting quotas for project 6f2d284955ea4d12b60ceba4f7a53e87. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:32:32.318800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-2568ad9c-1300-44ab-8178-9aeee56c05d3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Getting quotas for user 3abce7098260457cad30873156a242d0 and project 6f2d284955ea4d12b60ceba4f7a53e87. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:32:32.337890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2568ad9c-1300-44ab-8178-9aeee56c05d3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2319 microversion: 2.1 time: 0.613909 Aug 13 04:32:32.339093 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 242/495] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Aug 13 04:32:31 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 616 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:32.343968 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b9a4a9a7-f67a-46b5-9e00-caa8a8b349cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:32.345050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b9a4a9a7-f67a-46b5-9e00-caa8a8b349cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:32.351382 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9a4a9a7-f67a-46b5-9e00-caa8a8b349cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:32.352639 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9a4a9a7-f67a-46b5-9e00-caa8a8b349cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:32.353640 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9a4a9a7-f67a-46b5-9e00-caa8a8b349cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:32.354221 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9a4a9a7-f67a-46b5-9e00-caa8a8b349cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:32.578395 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d462fa31-7cff-492d-920c-b851f6577d70 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:32.586246 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b9a4a9a7-f67a-46b5-9e00-caa8a8b349cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:32.588889 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d462fa31-7cff-492d-920c-b851f6577d70 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.357627 Aug 13 04:32:32.591447 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 254/496] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:32 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:32.606798 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b9a4a9a7-f67a-46b5-9e00-caa8a8b349cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:32.608345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b9a4a9a7-f67a-46b5-9e00-caa8a8b349cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:32.609545 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b9a4a9a7-f67a-46b5-9e00-caa8a8b349cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.269330 Aug 13 04:32:32.618169 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 243/497] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:32 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:32.834452 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8dd76d8d-829e-407f-a026-362e3ccdb0ee tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e082b5d5-a273-4624-a215-5e1b99162653"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:32.837363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8dd76d8d-829e-407f-a026-362e3ccdb0ee tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:32.848889 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8dd76d8d-829e-407f-a026-362e3ccdb0ee tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:32.850099 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8dd76d8d-829e-407f-a026-362e3ccdb0ee tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:32.851134 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8dd76d8d-829e-407f-a026-362e3ccdb0ee tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:32.851798 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8dd76d8d-829e-407f-a026-362e3ccdb0ee tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.002414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-8dd76d8d-829e-407f-a026-362e3ccdb0ee tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] HTTP exception thrown: Invalid volume: volume e082b5d5-a273-4624-a215-5e1b99162653 is already attached to instances: 4a362027-7dd0-4360-92f4-9028fd0081e7 Aug 13 04:32:33.003894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8dd76d8d-829e-407f-a026-362e3ccdb0ee tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Returning 400 to user: Invalid volume: volume e082b5d5-a273-4624-a215-5e1b99162653 is already attached to instances: 4a362027-7dd0-4360-92f4-9028fd0081e7 {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:32:33.005103 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8dd76d8d-829e-407f-a026-362e3ccdb0ee tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "POST /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.177808 Aug 13 04:32:33.006044 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 255/498] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:32:32 2021] POST /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7/os-volume_attachments => generated 174 bytes in 180 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Aug 13 04:32:33.024510 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f3a720f8-a43d-47b1-af1f-494e634f9728 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:33.025125 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f3a720f8-a43d-47b1-af1f-494e634f9728 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:33.038025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f3a720f8-a43d-47b1-af1f-494e634f9728 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:33.039449 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f3a720f8-a43d-47b1-af1f-494e634f9728 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.040915 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f3a720f8-a43d-47b1-af1f-494e634f9728 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:33.041793 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f3a720f8-a43d-47b1-af1f-494e634f9728 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.109127 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c5a750ca-7973-4219-b22f-df0ba867d056 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:33.109673 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c5a750ca-7973-4219-b22f-df0ba867d056 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:33.121794 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c5a750ca-7973-4219-b22f-df0ba867d056 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:33.123601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c5a750ca-7973-4219-b22f-df0ba867d056 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.125101 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c5a750ca-7973-4219-b22f-df0ba867d056 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:33.125725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c5a750ca-7973-4219-b22f-df0ba867d056 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.315248 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f3a720f8-a43d-47b1-af1f-494e634f9728 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:33.325928 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f3a720f8-a43d-47b1-af1f-494e634f9728 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.305963 Aug 13 04:32:33.326805 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 244/499] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:33 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:33.359868 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-c5a750ca-7973-4219-b22f-df0ba867d056 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lazy-loading 'services' on Instance uuid 4a362027-7dd0-4360-92f4-9028fd0081e7 {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:32:33.491011 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c5a750ca-7973-4219-b22f-df0ba867d056 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7/os-volume_attachments/e082b5d5-a273-4624-a215-5e1b99162653" status: 202 len: 0 microversion: 2.1 time: 0.385868 Aug 13 04:32:33.493467 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 256/500] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:32:33 2021] DELETE /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7/os-volume_attachments/e082b5d5-a273-4624-a215-5e1b99162653 => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:32:33.515420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1f6603a0-a62b-4861-9e9a-b2c3080ad7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:33.516871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1f6603a0-a62b-4861-9e9a-b2c3080ad7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:33.525541 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1f6603a0-a62b-4861-9e9a-b2c3080ad7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:33.526241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1f6603a0-a62b-4861-9e9a-b2c3080ad7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.527478 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1f6603a0-a62b-4861-9e9a-b2c3080ad7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:33.528072 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1f6603a0-a62b-4861-9e9a-b2c3080ad7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.594669 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1f6603a0-a62b-4861-9e9a-b2c3080ad7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.097119 Aug 13 04:32:33.595546 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 245/501] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:32:33 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7/os-volume_attachments => generated 197 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:32:33.609334 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8147b8e8-08cf-4911-a0f1-493b24373619 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:33.610504 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8147b8e8-08cf-4911-a0f1-493b24373619 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:33.620239 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8147b8e8-08cf-4911-a0f1-493b24373619 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:33.620897 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8147b8e8-08cf-4911-a0f1-493b24373619 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.622001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8147b8e8-08cf-4911-a0f1-493b24373619 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:33.622865 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8147b8e8-08cf-4911-a0f1-493b24373619 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.637880 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f32c90e1-6dbf-4bef-abc6-874dbdbc27ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:33.638792 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f32c90e1-6dbf-4bef-abc6-874dbdbc27ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:33.648422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f32c90e1-6dbf-4bef-abc6-874dbdbc27ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:33.651510 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f32c90e1-6dbf-4bef-abc6-874dbdbc27ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.652556 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f32c90e1-6dbf-4bef-abc6-874dbdbc27ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:33.653180 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f32c90e1-6dbf-4bef-abc6-874dbdbc27ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:33.953081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-8147b8e8-08cf-4911-a0f1-493b24373619 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:33.969206 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8147b8e8-08cf-4911-a0f1-493b24373619 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.364173 Aug 13 04:32:33.971777 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 257/502] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:33 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:33.990325 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f32c90e1-6dbf-4bef-abc6-874dbdbc27ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:34.001120 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f32c90e1-6dbf-4bef-abc6-874dbdbc27ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:34.003865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f32c90e1-6dbf-4bef-abc6-874dbdbc27ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:34.005815 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f32c90e1-6dbf-4bef-abc6-874dbdbc27ba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.373854 Aug 13 04:32:34.018714 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 246/503] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:33 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:32:34.345228 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-6c403e83-eb23-4381-825c-7c9dd49f00e3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:34.345938 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6c403e83-eb23-4381-825c-7c9dd49f00e3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:34.357739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6c403e83-eb23-4381-825c-7c9dd49f00e3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:34.358177 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6c403e83-eb23-4381-825c-7c9dd49f00e3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:34.359141 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6c403e83-eb23-4381-825c-7c9dd49f00e3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:34.359661 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6c403e83-eb23-4381-825c-7c9dd49f00e3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:34.608496 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3bdad44a-94e7-4d49-8b31-f324d94e8d31 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:34.609689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3bdad44a-94e7-4d49-8b31-f324d94e8d31 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:34.642774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3bdad44a-94e7-4d49-8b31-f324d94e8d31 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:34.646930 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3bdad44a-94e7-4d49-8b31-f324d94e8d31 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:34.648444 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3bdad44a-94e7-4d49-8b31-f324d94e8d31 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:34.651928 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3bdad44a-94e7-4d49-8b31-f324d94e8d31 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:34.658568 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-6c403e83-eb23-4381-825c-7c9dd49f00e3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:34.685362 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-6c403e83-eb23-4381-825c-7c9dd49f00e3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.341332 Aug 13 04:32:34.688724 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 258/504] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:34 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:34.733214 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3bdad44a-94e7-4d49-8b31-f324d94e8d31 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.129990 Aug 13 04:32:34.739464 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 247/505] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:32:34 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:32:34.940857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-75803286", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "networks": [{"uuid": "e5a4407b-136d-4505-b628-117c1b1fc3a4"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:34.985842 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-74433dd7-c1a1-48f0-8eeb-73dfc2512b80 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:34.986465 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-74433dd7-c1a1-48f0-8eeb-73dfc2512b80 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:34.992864 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74433dd7-c1a1-48f0-8eeb-73dfc2512b80 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:34.993315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74433dd7-c1a1-48f0-8eeb-73dfc2512b80 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:34.994134 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74433dd7-c1a1-48f0-8eeb-73dfc2512b80 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:34.994590 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74433dd7-c1a1-48f0-8eeb-73dfc2512b80 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:35.190950 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-74433dd7-c1a1-48f0-8eeb-73dfc2512b80 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:35.200355 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-74433dd7-c1a1-48f0-8eeb-73dfc2512b80 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.218422 Aug 13 04:32:35.206241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 248/506] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:34 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:35.214029 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a84380aa-4a56-4878-a63d-1e4285a16719 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:35.215356 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a84380aa-4a56-4878-a63d-1e4285a16719 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:35.222050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a84380aa-4a56-4878-a63d-1e4285a16719 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:35.222644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a84380aa-4a56-4878-a63d-1e4285a16719 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:35.223527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a84380aa-4a56-4878-a63d-1e4285a16719 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:35.224066 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a84380aa-4a56-4878-a63d-1e4285a16719 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:35.388830 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a84380aa-4a56-4878-a63d-1e4285a16719 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:35.398504 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a84380aa-4a56-4878-a63d-1e4285a16719 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:35.400420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a84380aa-4a56-4878-a63d-1e4285a16719 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:35.401964 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a84380aa-4a56-4878-a63d-1e4285a16719 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.194247 Aug 13 04:32:35.403031 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 249/507] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:35 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:35.706508 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9101e57e-37ae-49b7-8d46-39b97b1c7c1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:35.707963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9101e57e-37ae-49b7-8d46-39b97b1c7c1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:35.719321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9101e57e-37ae-49b7-8d46-39b97b1c7c1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:35.720175 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9101e57e-37ae-49b7-8d46-39b97b1c7c1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:35.723763 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9101e57e-37ae-49b7-8d46-39b97b1c7c1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:35.725747 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9101e57e-37ae-49b7-8d46-39b97b1c7c1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:35.935277 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9101e57e-37ae-49b7-8d46-39b97b1c7c1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:35.945317 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9101e57e-37ae-49b7-8d46-39b97b1c7c1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.244151 Aug 13 04:32:35.945847 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 250/508] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:35 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:36.217641 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d73085e5-fe30-4c4d-8710-5f84ea4ae053 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:36.218280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d73085e5-fe30-4c4d-8710-5f84ea4ae053 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:36.230813 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d73085e5-fe30-4c4d-8710-5f84ea4ae053 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:36.231215 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d73085e5-fe30-4c4d-8710-5f84ea4ae053 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:36.232021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d73085e5-fe30-4c4d-8710-5f84ea4ae053 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:36.232621 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d73085e5-fe30-4c4d-8710-5f84ea4ae053 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:36.370147 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d73085e5-fe30-4c4d-8710-5f84ea4ae053 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:36.377416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d73085e5-fe30-4c4d-8710-5f84ea4ae053 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.163490 Aug 13 04:32:36.378005 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 251/509] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:36 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:36.421963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e587f274-736f-4791-8fbf-b1b52f24e797 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:36.422596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e587f274-736f-4791-8fbf-b1b52f24e797 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:36.428679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e587f274-736f-4791-8fbf-b1b52f24e797 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:36.429154 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e587f274-736f-4791-8fbf-b1b52f24e797 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:36.430017 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e587f274-736f-4791-8fbf-b1b52f24e797 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:36.430477 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e587f274-736f-4791-8fbf-b1b52f24e797 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:36.573887 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e587f274-736f-4791-8fbf-b1b52f24e797 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:36.581822 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e587f274-736f-4791-8fbf-b1b52f24e797 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:36.583284 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e587f274-736f-4791-8fbf-b1b52f24e797 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:36.584419 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e587f274-736f-4791-8fbf-b1b52f24e797 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.166284 Aug 13 04:32:36.584972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 252/510] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:36 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:32:36.962746 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6406be4b-7122-4011-93ff-19024179d5b1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:36.963393 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6406be4b-7122-4011-93ff-19024179d5b1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:36.970115 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6406be4b-7122-4011-93ff-19024179d5b1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:36.970571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6406be4b-7122-4011-93ff-19024179d5b1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:36.971885 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6406be4b-7122-4011-93ff-19024179d5b1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:36.972326 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6406be4b-7122-4011-93ff-19024179d5b1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:37.114178 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6406be4b-7122-4011-93ff-19024179d5b1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:37.122849 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6406be4b-7122-4011-93ff-19024179d5b1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.164216 Aug 13 04:32:37.127032 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 253/511] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:36 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:37.395865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b6955f0e-975e-4fcb-92b1-06f054a3f249 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:37.396512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b6955f0e-975e-4fcb-92b1-06f054a3f249 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:37.402561 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b6955f0e-975e-4fcb-92b1-06f054a3f249 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:37.403001 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b6955f0e-975e-4fcb-92b1-06f054a3f249 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:37.403757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b6955f0e-975e-4fcb-92b1-06f054a3f249 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:37.404187 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b6955f0e-975e-4fcb-92b1-06f054a3f249 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:37.553642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b6955f0e-975e-4fcb-92b1-06f054a3f249 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:37.565274 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b6955f0e-975e-4fcb-92b1-06f054a3f249 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.172933 Aug 13 04:32:37.576837 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 254/512] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:37 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:37.613161 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-747ad262-4121-428d-a578-c488a93f5b3d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:37.613812 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-747ad262-4121-428d-a578-c488a93f5b3d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:37.622585 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-747ad262-4121-428d-a578-c488a93f5b3d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:37.623209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-747ad262-4121-428d-a578-c488a93f5b3d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:37.624638 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-747ad262-4121-428d-a578-c488a93f5b3d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:37.625053 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-747ad262-4121-428d-a578-c488a93f5b3d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:37.829898 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-747ad262-4121-428d-a578-c488a93f5b3d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:37.839943 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-747ad262-4121-428d-a578-c488a93f5b3d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:37.841702 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-747ad262-4121-428d-a578-c488a93f5b3d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:37.843173 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-747ad262-4121-428d-a578-c488a93f5b3d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.233702 Aug 13 04:32:37.843732 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 255/513] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:37 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:38.139952 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3a2fff5d-a1ba-44d7-850d-256f9a7178ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:38.140670 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3a2fff5d-a1ba-44d7-850d-256f9a7178ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:38.146760 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a2fff5d-a1ba-44d7-850d-256f9a7178ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:38.147228 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a2fff5d-a1ba-44d7-850d-256f9a7178ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:38.148082 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a2fff5d-a1ba-44d7-850d-256f9a7178ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:38.148522 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a2fff5d-a1ba-44d7-850d-256f9a7178ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:38.278665 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3a2fff5d-a1ba-44d7-850d-256f9a7178ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:38.287641 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3a2fff5d-a1ba-44d7-850d-256f9a7178ed tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1721 microversion: 2.1 time: 0.151391 Aug 13 04:32:38.289264 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 256/514] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:38 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:38.587915 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7de56880-9a56-4279-81ab-5046c447348b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:38.589376 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7de56880-9a56-4279-81ab-5046c447348b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:38.600168 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7de56880-9a56-4279-81ab-5046c447348b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:38.601830 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7de56880-9a56-4279-81ab-5046c447348b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:38.603416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7de56880-9a56-4279-81ab-5046c447348b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:38.604076 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7de56880-9a56-4279-81ab-5046c447348b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:38.841509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7de56880-9a56-4279-81ab-5046c447348b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:38.853908 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7de56880-9a56-4279-81ab-5046c447348b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.272917 Aug 13 04:32:38.869829 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 257/515] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:38 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:38.877813 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4fabaaff-b7f0-48ba-9776-e0db9d795a56 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:38.878466 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4fabaaff-b7f0-48ba-9776-e0db9d795a56 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:38.885251 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4fabaaff-b7f0-48ba-9776-e0db9d795a56 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:38.885852 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4fabaaff-b7f0-48ba-9776-e0db9d795a56 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:38.886717 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4fabaaff-b7f0-48ba-9776-e0db9d795a56 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:38.887281 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4fabaaff-b7f0-48ba-9776-e0db9d795a56 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:39.030361 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4fabaaff-b7f0-48ba-9776-e0db9d795a56 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:39.038885 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4fabaaff-b7f0-48ba-9776-e0db9d795a56 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:39.040404 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4fabaaff-b7f0-48ba-9776-e0db9d795a56 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:39.041567 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4fabaaff-b7f0-48ba-9776-e0db9d795a56 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.170298 Aug 13 04:32:39.042130 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 258/516] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:38 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:39.305539 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5a03445d-65f8-4fa1-81a2-2de5ce5606e8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:39.306397 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5a03445d-65f8-4fa1-81a2-2de5ce5606e8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:39.312330 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5a03445d-65f8-4fa1-81a2-2de5ce5606e8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:39.312860 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5a03445d-65f8-4fa1-81a2-2de5ce5606e8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:39.313740 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5a03445d-65f8-4fa1-81a2-2de5ce5606e8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:39.314235 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5a03445d-65f8-4fa1-81a2-2de5ce5606e8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:39.453547 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5a03445d-65f8-4fa1-81a2-2de5ce5606e8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:39.463242 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5a03445d-65f8-4fa1-81a2-2de5ce5606e8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1698 microversion: 2.1 time: 0.161324 Aug 13 04:32:39.463871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 259/517] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:39 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1698 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:39.479943 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-60f6fc78-0861-4b9c-a717-83d2e94734aa tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:39.487144 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-60f6fc78-0861-4b9c-a717-83d2e94734aa tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:39.487615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-60f6fc78-0861-4b9c-a717-83d2e94734aa tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:39.561596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-60f6fc78-0861-4b9c-a717-83d2e94734aa tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Going to try to start instance {{(pid=108287) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 13 04:32:39.616659 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-60f6fc78-0861-4b9c-a717-83d2e94734aa tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 202 len: 0 microversion: 2.1 time: 0.140602 Aug 13 04:32:39.617309 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 260/518] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:32:39 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:32:39.625583 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2a9882e6-affc-4c12-8913-56fc2b055dff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:39.626277 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2a9882e6-affc-4c12-8913-56fc2b055dff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:39.635359 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2a9882e6-affc-4c12-8913-56fc2b055dff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:39.635804 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2a9882e6-affc-4c12-8913-56fc2b055dff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:39.636595 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2a9882e6-affc-4c12-8913-56fc2b055dff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:39.637029 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2a9882e6-affc-4c12-8913-56fc2b055dff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:39.821994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2a9882e6-affc-4c12-8913-56fc2b055dff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:39.830349 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2a9882e6-affc-4c12-8913-56fc2b055dff tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1707 microversion: 2.1 time: 0.208242 Aug 13 04:32:39.830823 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 261/519] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:39 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1707 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:39.885684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9fc239dc-abff-46b3-b3ed-e3718d57cdcc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:39.886491 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9fc239dc-abff-46b3-b3ed-e3718d57cdcc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:39.894470 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9fc239dc-abff-46b3-b3ed-e3718d57cdcc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:39.894802 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9fc239dc-abff-46b3-b3ed-e3718d57cdcc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:39.896021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9fc239dc-abff-46b3-b3ed-e3718d57cdcc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:39.896480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9fc239dc-abff-46b3-b3ed-e3718d57cdcc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:40.093535 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9fc239dc-abff-46b3-b3ed-e3718d57cdcc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:40.101248 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9fc239dc-abff-46b3-b3ed-e3718d57cdcc tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.222771 Aug 13 04:32:40.110567 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 262/520] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:39 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:40.110567 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c5edee71-86a4-490b-ba2a-af3265a6fcf9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:40.110567 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c5edee71-86a4-490b-ba2a-af3265a6fcf9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:40.113757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5edee71-86a4-490b-ba2a-af3265a6fcf9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:40.114207 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5edee71-86a4-490b-ba2a-af3265a6fcf9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:40.114988 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5edee71-86a4-490b-ba2a-af3265a6fcf9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:40.115425 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5edee71-86a4-490b-ba2a-af3265a6fcf9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:40.329583 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c5edee71-86a4-490b-ba2a-af3265a6fcf9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:40.338378 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c5edee71-86a4-490b-ba2a-af3265a6fcf9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:40.339820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c5edee71-86a4-490b-ba2a-af3265a6fcf9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:40.340962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c5edee71-86a4-490b-ba2a-af3265a6fcf9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.237657 Aug 13 04:32:40.341715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 263/521] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:40 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:40.887949 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-192f5a2e-8ee5-44ed-b696-1c82e336cb99 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:40.888848 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-192f5a2e-8ee5-44ed-b696-1c82e336cb99 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:40.894945 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-192f5a2e-8ee5-44ed-b696-1c82e336cb99 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:40.895393 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-192f5a2e-8ee5-44ed-b696-1c82e336cb99 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:40.896159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-192f5a2e-8ee5-44ed-b696-1c82e336cb99 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:40.896618 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-192f5a2e-8ee5-44ed-b696-1c82e336cb99 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:41.028125 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-192f5a2e-8ee5-44ed-b696-1c82e336cb99 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:41.036027 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-192f5a2e-8ee5-44ed-b696-1c82e336cb99 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1707 microversion: 2.1 time: 0.151872 Aug 13 04:32:41.036588 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 264/522] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:40 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1707 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:41.118705 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-34912824-e297-4c3e-a7f0-91cc6dd6e627 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:41.119314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-34912824-e297-4c3e-a7f0-91cc6dd6e627 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:41.125357 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34912824-e297-4c3e-a7f0-91cc6dd6e627 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:41.125850 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34912824-e297-4c3e-a7f0-91cc6dd6e627 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:41.126628 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34912824-e297-4c3e-a7f0-91cc6dd6e627 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:41.127066 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34912824-e297-4c3e-a7f0-91cc6dd6e627 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:41.270534 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-34912824-e297-4c3e-a7f0-91cc6dd6e627 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:41.279214 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-34912824-e297-4c3e-a7f0-91cc6dd6e627 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.164843 Aug 13 04:32:41.280385 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 265/523] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:41 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:41.361265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-63b13076-e53c-4e5a-a2e1-b7cb480deb4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:41.362806 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-63b13076-e53c-4e5a-a2e1-b7cb480deb4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:41.369358 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-63b13076-e53c-4e5a-a2e1-b7cb480deb4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:41.369835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-63b13076-e53c-4e5a-a2e1-b7cb480deb4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:41.370615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-63b13076-e53c-4e5a-a2e1-b7cb480deb4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:41.371119 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-63b13076-e53c-4e5a-a2e1-b7cb480deb4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:41.551484 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-63b13076-e53c-4e5a-a2e1-b7cb480deb4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:41.562736 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-63b13076-e53c-4e5a-a2e1-b7cb480deb4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:41.564290 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-63b13076-e53c-4e5a-a2e1-b7cb480deb4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:41.565528 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-63b13076-e53c-4e5a-a2e1-b7cb480deb4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.207961 Aug 13 04:32:41.576493 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 266/524] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:41 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:32:41.670378 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] validate_networks() for [('e5a4407b-136d-4505-b628-117c1b1fc3a4', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:32:42.053780 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5cca1b05-f309-48cb-a1f5-ac6f5ccb5cb0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:42.054671 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5cca1b05-f309-48cb-a1f5-ac6f5ccb5cb0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:42.061154 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5cca1b05-f309-48cb-a1f5-ac6f5ccb5cb0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:42.061830 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5cca1b05-f309-48cb-a1f5-ac6f5ccb5cb0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:42.062773 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5cca1b05-f309-48cb-a1f5-ac6f5ccb5cb0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:42.063372 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5cca1b05-f309-48cb-a1f5-ac6f5ccb5cb0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:42.185725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:32:42.185725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:32:42.186272 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:32:42.186898 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:32:42.187572 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:32:42.199183 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:42.200282 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:42.205866 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:42.206560 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:42.233017 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Getting quotas for project 44afcd45727640ec80dc17fe4fcf67fb. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:32:42.238699 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Getting quotas for user 1c6fcd7ffd124e7aa7ace34bed7f7423 and project 44afcd45727640ec80dc17fe4fcf67fb. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:32:42.252420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5cca1b05-f309-48cb-a1f5-ac6f5ccb5cb0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:42.262698 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:32:42.263708 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5cca1b05-f309-48cb-a1f5-ac6f5ccb5cb0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1711 microversion: 2.1 time: 0.213869 Aug 13 04:32:42.265044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 267/525] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:42 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1711 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:42.268089 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:32:42.307778 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-62f28fb8-9139-42d7-8c70-fdb72ff7904b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:42.308750 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-62f28fb8-9139-42d7-8c70-fdb72ff7904b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:42.316704 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-62f28fb8-9139-42d7-8c70-fdb72ff7904b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:42.317792 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-62f28fb8-9139-42d7-8c70-fdb72ff7904b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:42.318786 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-62f28fb8-9139-42d7-8c70-fdb72ff7904b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:42.320055 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-62f28fb8-9139-42d7-8c70-fdb72ff7904b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:42.357201 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-76a94f99-7f42-49f6-8483-835737d58bfa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 7.420288 Aug 13 04:32:42.357873 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 259/526] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:32:34 2021] POST /compute/v2.1/servers => generated 380 bytes in 7422 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:32:42.369870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-47c1394a-fd91-44ee-afb5-cdbde569c0f3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:42.370489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-47c1394a-fd91-44ee-afb5-cdbde569c0f3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:42.496180 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-47c1394a-fd91-44ee-afb5-cdbde569c0f3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:42.511092 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-47c1394a-fd91-44ee-afb5-cdbde569c0f3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1216 microversion: 2.1 time: 0.145559 Aug 13 04:32:42.511680 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 260/527] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:42 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1216 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:42.576767 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-62f28fb8-9139-42d7-8c70-fdb72ff7904b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:42.584023 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ef1580a5-4d3f-444c-be82-6b45b828d346 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:42.584817 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ef1580a5-4d3f-444c-be82-6b45b828d346 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:42.599157 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-62f28fb8-9139-42d7-8c70-fdb72ff7904b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.301404 Aug 13 04:32:42.604800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 268/528] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:42 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:42.611170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef1580a5-4d3f-444c-be82-6b45b828d346 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:42.611632 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef1580a5-4d3f-444c-be82-6b45b828d346 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:42.612448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef1580a5-4d3f-444c-be82-6b45b828d346 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:42.612900 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef1580a5-4d3f-444c-be82-6b45b828d346 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:42.794726 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ef1580a5-4d3f-444c-be82-6b45b828d346 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:42.804952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ef1580a5-4d3f-444c-be82-6b45b828d346 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:42.806684 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ef1580a5-4d3f-444c-be82-6b45b828d346 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:42.807809 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ef1580a5-4d3f-444c-be82-6b45b828d346 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.227579 Aug 13 04:32:42.808463 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 261/529] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:42 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:32:43.528705 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c1f887bc-b0c5-490b-a40c-9144973eea1c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:43.529465 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c1f887bc-b0c5-490b-a40c-9144973eea1c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:43.552768 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1f887bc-b0c5-490b-a40c-9144973eea1c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:43.553209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1f887bc-b0c5-490b-a40c-9144973eea1c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:43.554078 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1f887bc-b0c5-490b-a40c-9144973eea1c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:43.554697 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1f887bc-b0c5-490b-a40c-9144973eea1c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:43.617379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-04f7995f-d3b8-4210-983b-8b4700cd1f62 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:43.618501 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-04f7995f-d3b8-4210-983b-8b4700cd1f62 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:43.631419 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-04f7995f-d3b8-4210-983b-8b4700cd1f62 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:43.632665 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-04f7995f-d3b8-4210-983b-8b4700cd1f62 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:43.633884 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-04f7995f-d3b8-4210-983b-8b4700cd1f62 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:43.634501 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-04f7995f-d3b8-4210-983b-8b4700cd1f62 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:43.655732 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c1f887bc-b0c5-490b-a40c-9144973eea1c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:43.666503 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c1f887bc-b0c5-490b-a40c-9144973eea1c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1268 microversion: 2.1 time: 0.140095 Aug 13 04:32:43.667366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 269/530] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:43 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1268 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:43.829893 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f11bd4b1-861f-4191-bc72-7e75079548f3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:43.830977 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f11bd4b1-861f-4191-bc72-7e75079548f3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:43.841930 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f11bd4b1-861f-4191-bc72-7e75079548f3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:43.842956 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f11bd4b1-861f-4191-bc72-7e75079548f3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:43.844228 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f11bd4b1-861f-4191-bc72-7e75079548f3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:43.845325 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f11bd4b1-861f-4191-bc72-7e75079548f3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:44.024261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-04f7995f-d3b8-4210-983b-8b4700cd1f62 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:44.043200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-04f7995f-d3b8-4210-983b-8b4700cd1f62 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1521 microversion: 2.1 time: 0.430500 Aug 13 04:32:44.055195 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 262/531] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:43 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1521 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:44.133276 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f11bd4b1-861f-4191-bc72-7e75079548f3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:44.144182 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f11bd4b1-861f-4191-bc72-7e75079548f3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:44.146390 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f11bd4b1-861f-4191-bc72-7e75079548f3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:44.148450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f11bd4b1-861f-4191-bc72-7e75079548f3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.324347 Aug 13 04:32:44.159763 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 270/532] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:43 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:44.685243 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9576573f-acaa-4acf-ae8f-d65f00d60190 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:44.685914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9576573f-acaa-4acf-ae8f-d65f00d60190 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:44.694183 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9576573f-acaa-4acf-ae8f-d65f00d60190 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:44.695509 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9576573f-acaa-4acf-ae8f-d65f00d60190 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:44.696668 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9576573f-acaa-4acf-ae8f-d65f00d60190 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:44.697622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9576573f-acaa-4acf-ae8f-d65f00d60190 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:44.956738 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9576573f-acaa-4acf-ae8f-d65f00d60190 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:44.974344 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9576573f-acaa-4acf-ae8f-d65f00d60190 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.291731 Aug 13 04:32:44.977587 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 263/533] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:44 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:45.060559 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ea5c6f98-3623-46a4-bf8f-63a725c60eb3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:45.061313 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ea5c6f98-3623-46a4-bf8f-63a725c60eb3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:45.074899 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ea5c6f98-3623-46a4-bf8f-63a725c60eb3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:45.075317 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ea5c6f98-3623-46a4-bf8f-63a725c60eb3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:45.078396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ea5c6f98-3623-46a4-bf8f-63a725c60eb3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:45.078828 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ea5c6f98-3623-46a4-bf8f-63a725c60eb3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:45.167215 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f4076c45-9209-4dfa-b377-3c2052e47fd7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:45.168518 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f4076c45-9209-4dfa-b377-3c2052e47fd7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:45.175320 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4076c45-9209-4dfa-b377-3c2052e47fd7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:45.176060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4076c45-9209-4dfa-b377-3c2052e47fd7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:45.177036 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4076c45-9209-4dfa-b377-3c2052e47fd7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:45.177536 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4076c45-9209-4dfa-b377-3c2052e47fd7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:45.486956 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f4076c45-9209-4dfa-b377-3c2052e47fd7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:45.499972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ea5c6f98-3623-46a4-bf8f-63a725c60eb3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:45.506014 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f4076c45-9209-4dfa-b377-3c2052e47fd7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:45.507863 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f4076c45-9209-4dfa-b377-3c2052e47fd7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:45.508999 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f4076c45-9209-4dfa-b377-3c2052e47fd7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.345629 Aug 13 04:32:45.510128 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 264/534] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:45 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:32:45.533300 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ea5c6f98-3623-46a4-bf8f-63a725c60eb3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1501 microversion: 2.1 time: 0.476665 Aug 13 04:32:45.536359 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 271/535] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:45 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1501 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:45.565346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-174420da-494b-4c1e-8b59-f5be4a3839ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:45.566458 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-174420da-494b-4c1e-8b59-f5be4a3839ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:45.574641 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-174420da-494b-4c1e-8b59-f5be4a3839ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:45.574925 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-174420da-494b-4c1e-8b59-f5be4a3839ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:45.577029 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-174420da-494b-4c1e-8b59-f5be4a3839ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:45.577799 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-174420da-494b-4c1e-8b59-f5be4a3839ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:45.815686 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-174420da-494b-4c1e-8b59-f5be4a3839ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:45.826654 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-174420da-494b-4c1e-8b59-f5be4a3839ae tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1515 microversion: 2.1 time: 0.277182 Aug 13 04:32:45.827917 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 265/536] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:45 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1515 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:45.912174 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-db313243-ced1-4eb1-aac1-f298fa1540a5 req-dc09d074-e053-406a-9a81-c40cad039988 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "17d3fbfa-ac7d-47d6-9682-00405fcb9a3f", "tag": "4eb63f7d-d59b-4c2c-928b-eaf2bb3b7564"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:45.915250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:32:45.915250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:32:45.930217 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-db313243-ced1-4eb1-aac1-f298fa1540a5 req-dc09d074-e053-406a-9a81-c40cad039988 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:45.931945 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-db313243-ced1-4eb1-aac1-f298fa1540a5 req-dc09d074-e053-406a-9a81-c40cad039988 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:45.953292 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-db313243-ced1-4eb1-aac1-f298fa1540a5 req-dc09d074-e053-406a-9a81-c40cad039988 service nova] Creating event network-changed:4eb63f7d-d59b-4c2c-928b-eaf2bb3b7564 for instance 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f on hv-cinder-75996 Aug 13 04:32:45.960122 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-db313243-ced1-4eb1-aac1-f298fa1540a5 req-dc09d074-e053-406a-9a81-c40cad039988 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053159 Aug 13 04:32:45.961372 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 272/537] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:32:45 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:32:45.997899 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e429bf36-87b8-4134-96ff-d34744184bf0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:45.999446 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e429bf36-87b8-4134-96ff-d34744184bf0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:46.012861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e429bf36-87b8-4134-96ff-d34744184bf0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:46.013334 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e429bf36-87b8-4134-96ff-d34744184bf0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:46.014181 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e429bf36-87b8-4134-96ff-d34744184bf0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:46.014742 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e429bf36-87b8-4134-96ff-d34744184bf0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:46.323325 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e429bf36-87b8-4134-96ff-d34744184bf0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:46.331152 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e429bf36-87b8-4134-96ff-d34744184bf0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.340374 Aug 13 04:32:46.331820 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 266/538] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:45 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:46.571947 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7f7e1549-4c6e-455a-86e9-ac9a8e4df8e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:46.572793 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7f7e1549-4c6e-455a-86e9-ac9a8e4df8e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:46.579073 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7f7e1549-4c6e-455a-86e9-ac9a8e4df8e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:46.579754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7f7e1549-4c6e-455a-86e9-ac9a8e4df8e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:46.580720 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7f7e1549-4c6e-455a-86e9-ac9a8e4df8e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:46.581339 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7f7e1549-4c6e-455a-86e9-ac9a8e4df8e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:46.786950 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7f7e1549-4c6e-455a-86e9-ac9a8e4df8e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:46.799075 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7f7e1549-4c6e-455a-86e9-ac9a8e4df8e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:46.801713 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7f7e1549-4c6e-455a-86e9-ac9a8e4df8e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:46.803929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7f7e1549-4c6e-455a-86e9-ac9a8e4df8e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.237358 Aug 13 04:32:46.805021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 273/539] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:46 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:47.354054 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3d207e2c-42a8-4085-afc2-5e411f0dc141 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:47.356112 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3d207e2c-42a8-4085-afc2-5e411f0dc141 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:47.367008 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3d207e2c-42a8-4085-afc2-5e411f0dc141 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:47.367810 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3d207e2c-42a8-4085-afc2-5e411f0dc141 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:47.369355 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3d207e2c-42a8-4085-afc2-5e411f0dc141 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:47.370050 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3d207e2c-42a8-4085-afc2-5e411f0dc141 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:47.464808 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-66c747c6-7f39-47f5-b739-7cb9655a3386 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:32:47.466835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-66c747c6-7f39-47f5-b739-7cb9655a3386 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:47.477285 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-66c747c6-7f39-47f5-b739-7cb9655a3386 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:47.477870 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-66c747c6-7f39-47f5-b739-7cb9655a3386 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:47.478918 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-66c747c6-7f39-47f5-b739-7cb9655a3386 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:47.479366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-66c747c6-7f39-47f5-b739-7cb9655a3386 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:47.505417 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-66c747c6-7f39-47f5-b739-7cb9655a3386 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lazy-loading 'flavor' on Instance uuid 25395051-723e-4a2e-a22c-7892a0285098 {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:32:47.552439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3d207e2c-42a8-4085-afc2-5e411f0dc141 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:47.561802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3d207e2c-42a8-4085-afc2-5e411f0dc141 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.212961 Aug 13 04:32:47.573043 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 267/540] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:47 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:47.591972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-66c747c6-7f39-47f5-b739-7cb9655a3386 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/action" status: 200 len: 32 microversion: 2.1 time: 0.130927 Aug 13 04:32:47.592924 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 274/541] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:32:47 2021] POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/action => generated 32 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:32:47.602400 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-13c1851a-656c-4d7f-80b0-d1099f8c4b04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:47.603266 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-13c1851a-656c-4d7f-80b0-d1099f8c4b04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:47.609833 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13c1851a-656c-4d7f-80b0-d1099f8c4b04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:47.610061 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13c1851a-656c-4d7f-80b0-d1099f8c4b04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:47.610951 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13c1851a-656c-4d7f-80b0-d1099f8c4b04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:47.611530 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13c1851a-656c-4d7f-80b0-d1099f8c4b04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:47.828043 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7edff59c-cabc-44e7-9ae8-c3ad7a54d87c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:47.829284 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7edff59c-cabc-44e7-9ae8-c3ad7a54d87c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:47.836027 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7edff59c-cabc-44e7-9ae8-c3ad7a54d87c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:47.836816 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7edff59c-cabc-44e7-9ae8-c3ad7a54d87c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:47.837692 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7edff59c-cabc-44e7-9ae8-c3ad7a54d87c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:47.838314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7edff59c-cabc-44e7-9ae8-c3ad7a54d87c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:47.851877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-13c1851a-656c-4d7f-80b0-d1099f8c4b04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:47.861253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-13c1851a-656c-4d7f-80b0-d1099f8c4b04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.262546 Aug 13 04:32:47.872487 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 268/542] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:47 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:32:48.106316 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7edff59c-cabc-44e7-9ae8-c3ad7a54d87c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:48.117392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7edff59c-cabc-44e7-9ae8-c3ad7a54d87c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:48.117392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7edff59c-cabc-44e7-9ae8-c3ad7a54d87c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:48.117392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7edff59c-cabc-44e7-9ae8-c3ad7a54d87c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.296550 Aug 13 04:32:48.127804 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 275/543] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:47 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:32:48.580131 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-13115cb7-88ac-4f08-9a34-03e68f9e3245 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:48.581397 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-13115cb7-88ac-4f08-9a34-03e68f9e3245 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:48.589908 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13115cb7-88ac-4f08-9a34-03e68f9e3245 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:48.590456 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13115cb7-88ac-4f08-9a34-03e68f9e3245 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:48.591306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13115cb7-88ac-4f08-9a34-03e68f9e3245 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:48.591828 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13115cb7-88ac-4f08-9a34-03e68f9e3245 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:48.723877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-13115cb7-88ac-4f08-9a34-03e68f9e3245 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:48.732221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-13115cb7-88ac-4f08-9a34-03e68f9e3245 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.155918 Aug 13 04:32:48.732815 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 269/544] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:48 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:48.884811 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-72ebf997-ca2b-4f89-b122-3a425f00c1b8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:48.885527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-72ebf997-ca2b-4f89-b122-3a425f00c1b8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:48.897890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-72ebf997-ca2b-4f89-b122-3a425f00c1b8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:48.898345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-72ebf997-ca2b-4f89-b122-3a425f00c1b8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:48.899151 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-72ebf997-ca2b-4f89-b122-3a425f00c1b8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:48.899584 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-72ebf997-ca2b-4f89-b122-3a425f00c1b8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:49.070886 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-72ebf997-ca2b-4f89-b122-3a425f00c1b8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:49.080054 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-72ebf997-ca2b-4f89-b122-3a425f00c1b8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.199321 Aug 13 04:32:49.081160 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 276/545] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:48 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:49.135400 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f398e32e-a57b-465b-9210-aba953c886b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:49.136006 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f398e32e-a57b-465b-9210-aba953c886b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:49.143033 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f398e32e-a57b-465b-9210-aba953c886b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:49.143556 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f398e32e-a57b-465b-9210-aba953c886b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:49.144414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f398e32e-a57b-465b-9210-aba953c886b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:49.144843 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f398e32e-a57b-465b-9210-aba953c886b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:49.275764 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f398e32e-a57b-465b-9210-aba953c886b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:49.284254 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f398e32e-a57b-465b-9210-aba953c886b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:49.285932 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f398e32e-a57b-465b-9210-aba953c886b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:49.287394 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f398e32e-a57b-465b-9210-aba953c886b4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.155784 Aug 13 04:32:49.288778 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 270/546] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:49 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:49.749718 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a2773ec8-1a2c-44b2-bb8f-19d0f7bb0873 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:49.750420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a2773ec8-1a2c-44b2-bb8f-19d0f7bb0873 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:49.757914 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a2773ec8-1a2c-44b2-bb8f-19d0f7bb0873 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:49.758376 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a2773ec8-1a2c-44b2-bb8f-19d0f7bb0873 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:49.759179 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a2773ec8-1a2c-44b2-bb8f-19d0f7bb0873 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:49.759617 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a2773ec8-1a2c-44b2-bb8f-19d0f7bb0873 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:49.892512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a2773ec8-1a2c-44b2-bb8f-19d0f7bb0873 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:49.900509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a2773ec8-1a2c-44b2-bb8f-19d0f7bb0873 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.154862 Aug 13 04:32:49.901106 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 277/547] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:49 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:50.098155 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fa79d101-ba75-4fcc-a171-1d85ae7aa480 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:50.098934 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fa79d101-ba75-4fcc-a171-1d85ae7aa480 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:50.105567 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa79d101-ba75-4fcc-a171-1d85ae7aa480 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:50.106017 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa79d101-ba75-4fcc-a171-1d85ae7aa480 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:50.106810 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa79d101-ba75-4fcc-a171-1d85ae7aa480 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:50.107264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa79d101-ba75-4fcc-a171-1d85ae7aa480 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:50.249075 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-fa79d101-ba75-4fcc-a171-1d85ae7aa480 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:50.257287 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fa79d101-ba75-4fcc-a171-1d85ae7aa480 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.162825 Aug 13 04:32:50.257911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 271/548] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:50 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:50.306583 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f7714c6c-3775-4f7d-93ea-e9f88da43304 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:50.307369 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f7714c6c-3775-4f7d-93ea-e9f88da43304 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:50.313223 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f7714c6c-3775-4f7d-93ea-e9f88da43304 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:50.313825 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f7714c6c-3775-4f7d-93ea-e9f88da43304 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:50.314690 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f7714c6c-3775-4f7d-93ea-e9f88da43304 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:50.315249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f7714c6c-3775-4f7d-93ea-e9f88da43304 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:50.464172 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f7714c6c-3775-4f7d-93ea-e9f88da43304 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:50.473516 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f7714c6c-3775-4f7d-93ea-e9f88da43304 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:50.486137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f7714c6c-3775-4f7d-93ea-e9f88da43304 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:50.487390 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f7714c6c-3775-4f7d-93ea-e9f88da43304 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.184883 Aug 13 04:32:50.487980 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 278/549] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:50 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:50.918176 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-cbf49ce1-c24e-4b05-86d9-08148b010398 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:50.919221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-cbf49ce1-c24e-4b05-86d9-08148b010398 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:50.925346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cbf49ce1-c24e-4b05-86d9-08148b010398 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:50.926024 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cbf49ce1-c24e-4b05-86d9-08148b010398 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:50.926790 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cbf49ce1-c24e-4b05-86d9-08148b010398 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:50.927212 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cbf49ce1-c24e-4b05-86d9-08148b010398 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:51.060366 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-cbf49ce1-c24e-4b05-86d9-08148b010398 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:51.071217 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-cbf49ce1-c24e-4b05-86d9-08148b010398 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.156731 Aug 13 04:32:51.072353 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 272/550] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:50 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:51.274984 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f6cba54f-9238-430b-ad00-cc8a9905aa27 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:51.275873 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f6cba54f-9238-430b-ad00-cc8a9905aa27 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:51.284412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f6cba54f-9238-430b-ad00-cc8a9905aa27 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:51.284858 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f6cba54f-9238-430b-ad00-cc8a9905aa27 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:51.285832 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f6cba54f-9238-430b-ad00-cc8a9905aa27 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:51.286744 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f6cba54f-9238-430b-ad00-cc8a9905aa27 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:51.436601 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f6cba54f-9238-430b-ad00-cc8a9905aa27 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:51.446893 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f6cba54f-9238-430b-ad00-cc8a9905aa27 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.176439 Aug 13 04:32:51.447468 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 279/551] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:51 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:51.507456 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-93c0cefd-d356-4e7c-9cb5-771e59a217a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:51.508070 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-93c0cefd-d356-4e7c-9cb5-771e59a217a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:51.514411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-93c0cefd-d356-4e7c-9cb5-771e59a217a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:51.514857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-93c0cefd-d356-4e7c-9cb5-771e59a217a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:51.515631 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-93c0cefd-d356-4e7c-9cb5-771e59a217a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:51.516232 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-93c0cefd-d356-4e7c-9cb5-771e59a217a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:51.661511 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-93c0cefd-d356-4e7c-9cb5-771e59a217a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:51.672098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-93c0cefd-d356-4e7c-9cb5-771e59a217a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:51.673619 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-93c0cefd-d356-4e7c-9cb5-771e59a217a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:51.674761 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-93c0cefd-d356-4e7c-9cb5-771e59a217a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.171781 Aug 13 04:32:51.685196 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 273/552] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:51 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:52.089217 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-164bfb0e-89cc-492d-aae1-a3170986a5f8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:52.089978 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-164bfb0e-89cc-492d-aae1-a3170986a5f8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:52.099147 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-164bfb0e-89cc-492d-aae1-a3170986a5f8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:52.099539 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-164bfb0e-89cc-492d-aae1-a3170986a5f8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:52.100781 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-164bfb0e-89cc-492d-aae1-a3170986a5f8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:52.101364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-164bfb0e-89cc-492d-aae1-a3170986a5f8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:52.246898 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-164bfb0e-89cc-492d-aae1-a3170986a5f8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:52.255310 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-164bfb0e-89cc-492d-aae1-a3170986a5f8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.170917 Aug 13 04:32:52.257039 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 280/553] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:52 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:52.463837 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-777f4e11-8943-4e16-b013-42a53c2c93b1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:52.464482 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-777f4e11-8943-4e16-b013-42a53c2c93b1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:52.471733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-777f4e11-8943-4e16-b013-42a53c2c93b1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:52.472185 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-777f4e11-8943-4e16-b013-42a53c2c93b1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:52.472962 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-777f4e11-8943-4e16-b013-42a53c2c93b1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:52.473401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-777f4e11-8943-4e16-b013-42a53c2c93b1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:52.621949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-777f4e11-8943-4e16-b013-42a53c2c93b1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:52.634339 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-777f4e11-8943-4e16-b013-42a53c2c93b1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.169869 Aug 13 04:32:52.649393 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 274/554] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:52 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:52.713333 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-cb674d89-d16b-4eaa-9607-7b28dc779877 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:52.714898 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-cb674d89-d16b-4eaa-9607-7b28dc779877 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:52.747336 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cb674d89-d16b-4eaa-9607-7b28dc779877 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:52.748000 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cb674d89-d16b-4eaa-9607-7b28dc779877 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:52.749033 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cb674d89-d16b-4eaa-9607-7b28dc779877 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:52.749740 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cb674d89-d16b-4eaa-9607-7b28dc779877 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:52.971559 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-cb674d89-d16b-4eaa-9607-7b28dc779877 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:52.989072 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-cb674d89-d16b-4eaa-9607-7b28dc779877 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:52.991636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-cb674d89-d16b-4eaa-9607-7b28dc779877 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:52.994023 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-cb674d89-d16b-4eaa-9607-7b28dc779877 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.304702 Aug 13 04:32:53.004422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 281/555] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:52 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:53.272503 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-da45bb04-e3fd-4b2c-8532-73bc28c4802f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:53.273020 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-da45bb04-e3fd-4b2c-8532-73bc28c4802f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:53.279729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-da45bb04-e3fd-4b2c-8532-73bc28c4802f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:53.280401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-da45bb04-e3fd-4b2c-8532-73bc28c4802f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:53.282204 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-da45bb04-e3fd-4b2c-8532-73bc28c4802f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:53.283096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-da45bb04-e3fd-4b2c-8532-73bc28c4802f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:53.435398 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-da45bb04-e3fd-4b2c-8532-73bc28c4802f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:53.446984 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-da45bb04-e3fd-4b2c-8532-73bc28c4802f tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.177985 Aug 13 04:32:53.448602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 275/556] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:53 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:53.653977 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3a6f04e6-3522-4967-8f6b-e241b143512b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:53.654672 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3a6f04e6-3522-4967-8f6b-e241b143512b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:53.660915 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a6f04e6-3522-4967-8f6b-e241b143512b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:53.661676 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a6f04e6-3522-4967-8f6b-e241b143512b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:53.663250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a6f04e6-3522-4967-8f6b-e241b143512b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:53.663727 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a6f04e6-3522-4967-8f6b-e241b143512b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:53.809483 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3a6f04e6-3522-4967-8f6b-e241b143512b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:53.818356 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3a6f04e6-3522-4967-8f6b-e241b143512b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.169550 Aug 13 04:32:53.825629 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 282/557] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:53 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:54.012471 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1807175f-167c-4323-8de1-ed35bed1c170 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:54.013139 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1807175f-167c-4323-8de1-ed35bed1c170 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:54.019789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1807175f-167c-4323-8de1-ed35bed1c170 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:54.020261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1807175f-167c-4323-8de1-ed35bed1c170 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:54.021027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1807175f-167c-4323-8de1-ed35bed1c170 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:54.021477 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1807175f-167c-4323-8de1-ed35bed1c170 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:54.168459 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1807175f-167c-4323-8de1-ed35bed1c170 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:54.181553 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1807175f-167c-4323-8de1-ed35bed1c170 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:54.183130 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1807175f-167c-4323-8de1-ed35bed1c170 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:54.184278 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1807175f-167c-4323-8de1-ed35bed1c170 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.175531 Aug 13 04:32:54.185047 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 276/558] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:54 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:54.472006 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c2a269d1-1f56-41f6-9b44-998a3860b1bf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:54.472892 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c2a269d1-1f56-41f6-9b44-998a3860b1bf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:54.479509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2a269d1-1f56-41f6-9b44-998a3860b1bf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:54.479989 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2a269d1-1f56-41f6-9b44-998a3860b1bf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:54.480757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2a269d1-1f56-41f6-9b44-998a3860b1bf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:54.481365 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2a269d1-1f56-41f6-9b44-998a3860b1bf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:54.647351 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c2a269d1-1f56-41f6-9b44-998a3860b1bf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:54.657059 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c2a269d1-1f56-41f6-9b44-998a3860b1bf tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.188776 Aug 13 04:32:54.658136 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 283/559] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:54 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:54.836572 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-70c48891-63f9-46b3-a9c9-1fae04c94149 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:54.837089 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-70c48891-63f9-46b3-a9c9-1fae04c94149 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:54.845133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-70c48891-63f9-46b3-a9c9-1fae04c94149 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:54.845901 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-70c48891-63f9-46b3-a9c9-1fae04c94149 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:54.846868 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-70c48891-63f9-46b3-a9c9-1fae04c94149 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:54.847470 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-70c48891-63f9-46b3-a9c9-1fae04c94149 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:55.057648 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-70c48891-63f9-46b3-a9c9-1fae04c94149 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:55.065900 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-70c48891-63f9-46b3-a9c9-1fae04c94149 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.233606 Aug 13 04:32:55.067311 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 277/560] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:54 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:55.203580 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-382af4cd-9541-4078-a272-8921387e3edf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:55.204142 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-382af4cd-9541-4078-a272-8921387e3edf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:55.212525 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-382af4cd-9541-4078-a272-8921387e3edf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:55.213304 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-382af4cd-9541-4078-a272-8921387e3edf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:55.214314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-382af4cd-9541-4078-a272-8921387e3edf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:55.214940 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-382af4cd-9541-4078-a272-8921387e3edf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:55.362116 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-382af4cd-9541-4078-a272-8921387e3edf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:55.371160 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-382af4cd-9541-4078-a272-8921387e3edf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:55.373020 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-382af4cd-9541-4078-a272-8921387e3edf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:55.375819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-382af4cd-9541-4078-a272-8921387e3edf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.176009 Aug 13 04:32:55.376475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 284/561] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:55 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:55.679739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3f409066-b00b-4fbd-8214-9437a52de851 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:55.680557 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3f409066-b00b-4fbd-8214-9437a52de851 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:55.687996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3f409066-b00b-4fbd-8214-9437a52de851 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:55.688547 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3f409066-b00b-4fbd-8214-9437a52de851 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:55.689417 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3f409066-b00b-4fbd-8214-9437a52de851 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:55.689950 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3f409066-b00b-4fbd-8214-9437a52de851 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:55.835492 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3f409066-b00b-4fbd-8214-9437a52de851 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:55.843311 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3f409066-b00b-4fbd-8214-9437a52de851 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.170432 Aug 13 04:32:55.843883 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 278/562] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:55 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:56.084698 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3faaabec-644e-4bcb-b58e-51f078c73b9a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:56.086051 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3faaabec-644e-4bcb-b58e-51f078c73b9a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:56.092790 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3faaabec-644e-4bcb-b58e-51f078c73b9a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:56.093056 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3faaabec-644e-4bcb-b58e-51f078c73b9a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:56.093981 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3faaabec-644e-4bcb-b58e-51f078c73b9a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:56.094415 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3faaabec-644e-4bcb-b58e-51f078c73b9a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:56.236968 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3faaabec-644e-4bcb-b58e-51f078c73b9a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:56.245571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3faaabec-644e-4bcb-b58e-51f078c73b9a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.164961 Aug 13 04:32:56.247619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 285/563] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:56 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:56.393648 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1631eded-c322-4e59-b337-576bfa132bf0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:56.394927 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1631eded-c322-4e59-b337-576bfa132bf0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:56.401194 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1631eded-c322-4e59-b337-576bfa132bf0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:56.401679 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1631eded-c322-4e59-b337-576bfa132bf0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:56.402463 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1631eded-c322-4e59-b337-576bfa132bf0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:56.402902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1631eded-c322-4e59-b337-576bfa132bf0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:56.542696 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1631eded-c322-4e59-b337-576bfa132bf0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:56.557288 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1631eded-c322-4e59-b337-576bfa132bf0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:56.558903 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1631eded-c322-4e59-b337-576bfa132bf0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:56.560317 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1631eded-c322-4e59-b337-576bfa132bf0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.170778 Aug 13 04:32:56.561040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 279/564] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:56 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:32:56.861547 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-74985730-196b-4fb2-a62a-508cdab22c17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:56.862482 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-74985730-196b-4fb2-a62a-508cdab22c17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:56.869250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74985730-196b-4fb2-a62a-508cdab22c17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:56.869816 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74985730-196b-4fb2-a62a-508cdab22c17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:56.871619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74985730-196b-4fb2-a62a-508cdab22c17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:56.873305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-74985730-196b-4fb2-a62a-508cdab22c17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:57.020321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-74985730-196b-4fb2-a62a-508cdab22c17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:57.033131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-74985730-196b-4fb2-a62a-508cdab22c17 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.173519 Aug 13 04:32:57.034108 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 286/565] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:56 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:57.264126 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d8631850-fb71-4f69-bb54-6a1a6c963e85 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:57.264909 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d8631850-fb71-4f69-bb54-6a1a6c963e85 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:57.272323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d8631850-fb71-4f69-bb54-6a1a6c963e85 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:57.272780 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d8631850-fb71-4f69-bb54-6a1a6c963e85 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:57.273700 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d8631850-fb71-4f69-bb54-6a1a6c963e85 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:57.274240 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d8631850-fb71-4f69-bb54-6a1a6c963e85 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:57.421938 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d8631850-fb71-4f69-bb54-6a1a6c963e85 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:57.433744 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d8631850-fb71-4f69-bb54-6a1a6c963e85 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.173369 Aug 13 04:32:57.434558 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 280/566] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:57 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:57.580129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-de566b9d-72dc-47e5-9798-c8e5bf32e655 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:57.580934 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-de566b9d-72dc-47e5-9798-c8e5bf32e655 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:57.587887 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de566b9d-72dc-47e5-9798-c8e5bf32e655 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:57.588458 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de566b9d-72dc-47e5-9798-c8e5bf32e655 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:57.589341 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de566b9d-72dc-47e5-9798-c8e5bf32e655 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:57.589955 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de566b9d-72dc-47e5-9798-c8e5bf32e655 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:57.741659 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-de566b9d-72dc-47e5-9798-c8e5bf32e655 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:57.750769 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-de566b9d-72dc-47e5-9798-c8e5bf32e655 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:57.752496 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-de566b9d-72dc-47e5-9798-c8e5bf32e655 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:57.753835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-de566b9d-72dc-47e5-9798-c8e5bf32e655 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.178701 Aug 13 04:32:57.754769 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 287/567] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:57 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:58.052016 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b91a30d9-96d5-4df2-aec1-fedc9455c32a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:58.053316 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b91a30d9-96d5-4df2-aec1-fedc9455c32a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:58.060027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b91a30d9-96d5-4df2-aec1-fedc9455c32a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:58.060658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b91a30d9-96d5-4df2-aec1-fedc9455c32a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:58.061849 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b91a30d9-96d5-4df2-aec1-fedc9455c32a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:58.062486 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b91a30d9-96d5-4df2-aec1-fedc9455c32a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:58.259183 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b91a30d9-96d5-4df2-aec1-fedc9455c32a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:58.272551 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b91a30d9-96d5-4df2-aec1-fedc9455c32a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.225604 Aug 13 04:32:58.283540 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 281/568] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:58 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:58.451520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5d23434b-9201-4ca2-9e09-3c35a54f74ac tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:58.452430 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5d23434b-9201-4ca2-9e09-3c35a54f74ac tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:58.458610 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d23434b-9201-4ca2-9e09-3c35a54f74ac tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:58.459258 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d23434b-9201-4ca2-9e09-3c35a54f74ac tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:58.460118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d23434b-9201-4ca2-9e09-3c35a54f74ac tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:58.460557 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d23434b-9201-4ca2-9e09-3c35a54f74ac tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:58.602808 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5d23434b-9201-4ca2-9e09-3c35a54f74ac tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:58.611020 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5d23434b-9201-4ca2-9e09-3c35a54f74ac tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.163759 Aug 13 04:32:58.611892 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 288/569] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:58 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:58.772922 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-333679f9-2bf6-4a59-a5a9-834bf8bc7bf7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:58.773498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-333679f9-2bf6-4a59-a5a9-834bf8bc7bf7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:58.780180 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-333679f9-2bf6-4a59-a5a9-834bf8bc7bf7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:58.780719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-333679f9-2bf6-4a59-a5a9-834bf8bc7bf7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:58.781815 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-333679f9-2bf6-4a59-a5a9-834bf8bc7bf7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:58.782338 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-333679f9-2bf6-4a59-a5a9-834bf8bc7bf7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:58.951343 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-333679f9-2bf6-4a59-a5a9-834bf8bc7bf7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:58.964167 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-333679f9-2bf6-4a59-a5a9-834bf8bc7bf7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:58.966202 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-333679f9-2bf6-4a59-a5a9-834bf8bc7bf7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:58.967354 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-333679f9-2bf6-4a59-a5a9-834bf8bc7bf7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.198917 Aug 13 04:32:58.968044 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 282/570] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:58 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:32:59.291762 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-46da610b-74cc-42ca-aae0-f1fa47fd44af tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:59.292378 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-46da610b-74cc-42ca-aae0-f1fa47fd44af tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:59.301699 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46da610b-74cc-42ca-aae0-f1fa47fd44af tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:59.302406 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46da610b-74cc-42ca-aae0-f1fa47fd44af tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:59.304303 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46da610b-74cc-42ca-aae0-f1fa47fd44af tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:59.304890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46da610b-74cc-42ca-aae0-f1fa47fd44af tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:59.462127 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-46da610b-74cc-42ca-aae0-f1fa47fd44af tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:59.470631 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-46da610b-74cc-42ca-aae0-f1fa47fd44af tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.183410 Aug 13 04:32:59.471204 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 289/571] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:59 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:59.636671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a439f478-cd66-4a95-b29d-fe89e4043680 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:59.636671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a439f478-cd66-4a95-b29d-fe89e4043680 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:59.647315 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a439f478-cd66-4a95-b29d-fe89e4043680 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:59.647765 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a439f478-cd66-4a95-b29d-fe89e4043680 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:59.648552 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a439f478-cd66-4a95-b29d-fe89e4043680 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:59.648990 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a439f478-cd66-4a95-b29d-fe89e4043680 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:59.781414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a439f478-cd66-4a95-b29d-fe89e4043680 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:32:59.791076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a439f478-cd66-4a95-b29d-fe89e4043680 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.163854 Aug 13 04:32:59.791767 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 283/572] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:32:59 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:32:59.986160 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-716e6fe3-1009-456c-81ee-27e1ac5825ac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:32:59.986779 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-716e6fe3-1009-456c-81ee-27e1ac5825ac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:32:59.993253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-716e6fe3-1009-456c-81ee-27e1ac5825ac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:59.993723 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-716e6fe3-1009-456c-81ee-27e1ac5825ac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:32:59.994492 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-716e6fe3-1009-456c-81ee-27e1ac5825ac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:32:59.994919 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-716e6fe3-1009-456c-81ee-27e1ac5825ac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:00.123025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-716e6fe3-1009-456c-81ee-27e1ac5825ac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:00.132654 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-716e6fe3-1009-456c-81ee-27e1ac5825ac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:00.134455 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-716e6fe3-1009-456c-81ee-27e1ac5825ac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:00.136002 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-716e6fe3-1009-456c-81ee-27e1ac5825ac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1738 microversion: 2.20 time: 0.153302 Aug 13 04:33:00.136569 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 290/573] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:32:59 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:00.486667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ea1f0576-0cc2-4c36-bbcc-b16868f433f7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:00.487300 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ea1f0576-0cc2-4c36-bbcc-b16868f433f7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:00.494052 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ea1f0576-0cc2-4c36-bbcc-b16868f433f7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:00.494502 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ea1f0576-0cc2-4c36-bbcc-b16868f433f7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:00.495274 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ea1f0576-0cc2-4c36-bbcc-b16868f433f7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:00.495709 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ea1f0576-0cc2-4c36-bbcc-b16868f433f7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:00.615781 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ea1f0576-0cc2-4c36-bbcc-b16868f433f7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:00.623226 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ea1f0576-0cc2-4c36-bbcc-b16868f433f7 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.140119 Aug 13 04:33:00.623791 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 284/574] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:00 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:00.808632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9ae16440-dace-4835-bb1d-9aec9186e3be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:00.809253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9ae16440-dace-4835-bb1d-9aec9186e3be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:00.815057 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ae16440-dace-4835-bb1d-9aec9186e3be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:00.815510 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ae16440-dace-4835-bb1d-9aec9186e3be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:00.816754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ae16440-dace-4835-bb1d-9aec9186e3be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:00.817171 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ae16440-dace-4835-bb1d-9aec9186e3be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:00.951571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9ae16440-dace-4835-bb1d-9aec9186e3be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:00.960302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9ae16440-dace-4835-bb1d-9aec9186e3be tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.155344 Aug 13 04:33:00.961245 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 291/575] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:00 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:01.154866 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-18d101ab-86f1-40a5-9a1b-b491e8bab5cb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:01.155695 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-18d101ab-86f1-40a5-9a1b-b491e8bab5cb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:01.161187 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-18d101ab-86f1-40a5-9a1b-b491e8bab5cb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:01.161706 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-18d101ab-86f1-40a5-9a1b-b491e8bab5cb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:01.163040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-18d101ab-86f1-40a5-9a1b-b491e8bab5cb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:01.163478 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-18d101ab-86f1-40a5-9a1b-b491e8bab5cb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:01.377371 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-18d101ab-86f1-40a5-9a1b-b491e8bab5cb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:01.392785 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-18d101ab-86f1-40a5-9a1b-b491e8bab5cb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:01.395074 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-18d101ab-86f1-40a5-9a1b-b491e8bab5cb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:01.397563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-18d101ab-86f1-40a5-9a1b-b491e8bab5cb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1720 microversion: 2.20 time: 0.245225 Aug 13 04:33:01.398634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 285/576] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:01 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1720 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:01.639880 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7de58243-f4f2-4106-b9e6-c9737c7ca1ab tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:01.641205 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7de58243-f4f2-4106-b9e6-c9737c7ca1ab tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:01.648130 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7de58243-f4f2-4106-b9e6-c9737c7ca1ab tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:01.648677 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7de58243-f4f2-4106-b9e6-c9737c7ca1ab tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:01.649588 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7de58243-f4f2-4106-b9e6-c9737c7ca1ab tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:01.650100 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7de58243-f4f2-4106-b9e6-c9737c7ca1ab tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:01.978918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-66ec78ea-fdad-46ff-9c57-265109a144c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:01.979412 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-66ec78ea-fdad-46ff-9c57-265109a144c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:01.997346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-66ec78ea-fdad-46ff-9c57-265109a144c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:01.997828 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-66ec78ea-fdad-46ff-9c57-265109a144c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:01.998652 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-66ec78ea-fdad-46ff-9c57-265109a144c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:01.999083 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-66ec78ea-fdad-46ff-9c57-265109a144c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:02.015003 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7de58243-f4f2-4106-b9e6-c9737c7ca1ab tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:02.023217 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7de58243-f4f2-4106-b9e6-c9737c7ca1ab tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.386960 Aug 13 04:33:02.023796 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 292/577] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:01 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:02.128810 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-66ec78ea-fdad-46ff-9c57-265109a144c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:02.137125 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-66ec78ea-fdad-46ff-9c57-265109a144c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.163274 Aug 13 04:33:02.137736 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 286/578] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:01 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:02.415939 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c1e62c33-2191-4a12-9978-39f48b333bad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:02.416559 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c1e62c33-2191-4a12-9978-39f48b333bad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:02.422637 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1e62c33-2191-4a12-9978-39f48b333bad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:02.423097 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1e62c33-2191-4a12-9978-39f48b333bad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:02.423883 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1e62c33-2191-4a12-9978-39f48b333bad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:02.424327 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1e62c33-2191-4a12-9978-39f48b333bad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:02.567754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c1e62c33-2191-4a12-9978-39f48b333bad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:02.577073 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c1e62c33-2191-4a12-9978-39f48b333bad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:02.578597 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c1e62c33-2191-4a12-9978-39f48b333bad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:02.579728 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c1e62c33-2191-4a12-9978-39f48b333bad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1720 microversion: 2.20 time: 0.167539 Aug 13 04:33:02.580527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 293/579] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:02 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:03.039982 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f615e4f0-fe42-43eb-bcbc-3e2d47dbea3b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:03.040583 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f615e4f0-fe42-43eb-bcbc-3e2d47dbea3b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:03.046646 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f615e4f0-fe42-43eb-bcbc-3e2d47dbea3b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:03.047088 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f615e4f0-fe42-43eb-bcbc-3e2d47dbea3b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:03.047965 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f615e4f0-fe42-43eb-bcbc-3e2d47dbea3b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:03.048484 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f615e4f0-fe42-43eb-bcbc-3e2d47dbea3b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:03.156513 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-606aba34-c49a-4fa7-8897-57c073399273 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:03.157481 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-606aba34-c49a-4fa7-8897-57c073399273 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:03.164245 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-606aba34-c49a-4fa7-8897-57c073399273 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:03.167380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-606aba34-c49a-4fa7-8897-57c073399273 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:03.167380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-606aba34-c49a-4fa7-8897-57c073399273 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:03.167380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-606aba34-c49a-4fa7-8897-57c073399273 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:03.189563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f615e4f0-fe42-43eb-bcbc-3e2d47dbea3b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:03.197933 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f615e4f0-fe42-43eb-bcbc-3e2d47dbea3b tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.162008 Aug 13 04:33:03.199166 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 287/580] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:03 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:03.307440 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-b96fd473-92b0-4256-9eed-90047f6c61a5 req-d6459b89-09c4-4986-a97f-ad026a2800c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d299e5c1-cd60-4057-93a3-5d32e1908d2f", "name": "network-vif-unplugged", "status": "completed", "tag": "c3be48be-e5ee-48ea-a418-bc6c5c7a337c"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:03.309186 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:03.309186 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:33:03.309533 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-606aba34-c49a-4fa7-8897-57c073399273 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:03.317304 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-b96fd473-92b0-4256-9eed-90047f6c61a5 req-d6459b89-09c4-4986-a97f-ad026a2800c4 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:03.317531 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-606aba34-c49a-4fa7-8897-57c073399273 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.165346 Aug 13 04:33:03.317704 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-b96fd473-92b0-4256-9eed-90047f6c61a5 req-d6459b89-09c4-4986-a97f-ad026a2800c4 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:03.319305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 294/581] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:03 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:03.341314 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-b96fd473-92b0-4256-9eed-90047f6c61a5 req-d6459b89-09c4-4986-a97f-ad026a2800c4 service nova] Creating event network-vif-unplugged:c3be48be-e5ee-48ea-a418-bc6c5c7a337c for instance d299e5c1-cd60-4057-93a3-5d32e1908d2f on hv-cinder-75996 Aug 13 04:33:03.346649 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-b96fd473-92b0-4256-9eed-90047f6c61a5 req-d6459b89-09c4-4986-a97f-ad026a2800c4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.043093 Aug 13 04:33:03.347422 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 288/582] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:03 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:33:03.598283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8d76fe16-5ffb-41df-81cf-bbc662ab0f41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:03.598892 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8d76fe16-5ffb-41df-81cf-bbc662ab0f41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:03.605689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8d76fe16-5ffb-41df-81cf-bbc662ab0f41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:03.606141 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8d76fe16-5ffb-41df-81cf-bbc662ab0f41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:03.606910 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8d76fe16-5ffb-41df-81cf-bbc662ab0f41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:03.607344 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8d76fe16-5ffb-41df-81cf-bbc662ab0f41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:03.743996 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8d76fe16-5ffb-41df-81cf-bbc662ab0f41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:03.752795 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8d76fe16-5ffb-41df-81cf-bbc662ab0f41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:03.754447 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8d76fe16-5ffb-41df-81cf-bbc662ab0f41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:03.755762 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8d76fe16-5ffb-41df-81cf-bbc662ab0f41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1720 microversion: 2.20 time: 0.161250 Aug 13 04:33:03.756907 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 295/583] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:03 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:04.215638 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-762022ba-791f-4e72-86eb-6c72a7a4f9ad tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:04.216610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-762022ba-791f-4e72-86eb-6c72a7a4f9ad tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:04.222957 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-762022ba-791f-4e72-86eb-6c72a7a4f9ad tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:04.223505 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-762022ba-791f-4e72-86eb-6c72a7a4f9ad tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:04.224958 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-762022ba-791f-4e72-86eb-6c72a7a4f9ad tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:04.225508 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-762022ba-791f-4e72-86eb-6c72a7a4f9ad tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:04.342679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-832b61f7-215b-46c2-a596-b9784c73ae38 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:04.343574 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-832b61f7-215b-46c2-a596-b9784c73ae38 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:04.350024 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-832b61f7-215b-46c2-a596-b9784c73ae38 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:04.350632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-832b61f7-215b-46c2-a596-b9784c73ae38 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:04.351516 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-832b61f7-215b-46c2-a596-b9784c73ae38 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:04.352592 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-832b61f7-215b-46c2-a596-b9784c73ae38 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:04.527983 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-762022ba-791f-4e72-86eb-6c72a7a4f9ad tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:04.539357 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-762022ba-791f-4e72-86eb-6c72a7a4f9ad tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.327205 Aug 13 04:33:04.550039 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 289/584] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:04 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:04.703123 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-832b61f7-215b-46c2-a596-b9784c73ae38 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:04.710920 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-832b61f7-215b-46c2-a596-b9784c73ae38 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.378469 Aug 13 04:33:04.711641 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 296/585] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:04 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:04.775445 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ddbaef5a-8b85-4d37-b1e9-3e9434c8442e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:04.776158 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ddbaef5a-8b85-4d37-b1e9-3e9434c8442e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:04.782468 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ddbaef5a-8b85-4d37-b1e9-3e9434c8442e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:04.782918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ddbaef5a-8b85-4d37-b1e9-3e9434c8442e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:04.783832 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ddbaef5a-8b85-4d37-b1e9-3e9434c8442e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:04.784317 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ddbaef5a-8b85-4d37-b1e9-3e9434c8442e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:05.002260 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ddbaef5a-8b85-4d37-b1e9-3e9434c8442e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:05.012565 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ddbaef5a-8b85-4d37-b1e9-3e9434c8442e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:05.014265 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ddbaef5a-8b85-4d37-b1e9-3e9434c8442e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:05.015515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ddbaef5a-8b85-4d37-b1e9-3e9434c8442e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1720 microversion: 2.20 time: 0.244720 Aug 13 04:33:05.016051 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 290/586] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:04 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1720 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:05.382637 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-82473e69-fdc1-4e66-9c96-d00346254ea8 req-63fa97ea-fbfe-450f-9b71-b7d4462d75bd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d3fbfa-ac7d-47d6-9682-00405fcb9a3f", "name": "network-vif-plugged", "status": "completed", "tag": "4eb63f7d-d59b-4c2c-928b-eaf2bb3b7564"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:05.384239 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:05.384239 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:33:05.391252 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-82473e69-fdc1-4e66-9c96-d00346254ea8 req-63fa97ea-fbfe-450f-9b71-b7d4462d75bd service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:05.391704 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-82473e69-fdc1-4e66-9c96-d00346254ea8 req-63fa97ea-fbfe-450f-9b71-b7d4462d75bd service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:05.403928 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-82473e69-fdc1-4e66-9c96-d00346254ea8 req-63fa97ea-fbfe-450f-9b71-b7d4462d75bd service nova] Creating event network-vif-plugged:4eb63f7d-d59b-4c2c-928b-eaf2bb3b7564 for instance 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f on hv-cinder-75996 Aug 13 04:33:05.408989 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-82473e69-fdc1-4e66-9c96-d00346254ea8 req-63fa97ea-fbfe-450f-9b71-b7d4462d75bd service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031253 Aug 13 04:33:05.410245 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 297/587] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:05.557838 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e2c45fcb-1fae-42da-ac17-e1f088ad246c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:05.558431 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e2c45fcb-1fae-42da-ac17-e1f088ad246c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:05.567224 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e2c45fcb-1fae-42da-ac17-e1f088ad246c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:05.568136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e2c45fcb-1fae-42da-ac17-e1f088ad246c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:05.569176 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e2c45fcb-1fae-42da-ac17-e1f088ad246c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:05.569988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e2c45fcb-1fae-42da-ac17-e1f088ad246c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:05.729636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7aa2e9e7-9f9f-4b54-a5ec-738f3c565ab9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:05.730795 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7aa2e9e7-9f9f-4b54-a5ec-738f3c565ab9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:05.740743 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7aa2e9e7-9f9f-4b54-a5ec-738f3c565ab9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:05.741385 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7aa2e9e7-9f9f-4b54-a5ec-738f3c565ab9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:05.746808 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7aa2e9e7-9f9f-4b54-a5ec-738f3c565ab9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:05.747291 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7aa2e9e7-9f9f-4b54-a5ec-738f3c565ab9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:06.064457 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e2c45fcb-1fae-42da-ac17-e1f088ad246c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:06.070615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7aa2e9e7-9f9f-4b54-a5ec-738f3c565ab9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:06.074297 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e2c45fcb-1fae-42da-ac17-e1f088ad246c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1316 microversion: 2.1 time: 0.521266 Aug 13 04:33:06.075365 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 291/588] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:05 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1316 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:06.088730 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-30f7826b-8716-4b29-8316-39682a66438e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:06.089328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-30f7826b-8716-4b29-8316-39682a66438e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:06.092260 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7aa2e9e7-9f9f-4b54-a5ec-738f3c565ab9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.367916 Aug 13 04:33:06.093242 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 298/589] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:05 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:06.097130 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-30f7826b-8716-4b29-8316-39682a66438e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:06.097918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-30f7826b-8716-4b29-8316-39682a66438e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:06.099747 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-30f7826b-8716-4b29-8316-39682a66438e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:06.100902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-30f7826b-8716-4b29-8316-39682a66438e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:06.321155 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-30f7826b-8716-4b29-8316-39682a66438e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:06.330502 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-30f7826b-8716-4b29-8316-39682a66438e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:06.332076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-30f7826b-8716-4b29-8316-39682a66438e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:06.333827 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-30f7826b-8716-4b29-8316-39682a66438e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1663 microversion: 2.20 time: 0.256187 Aug 13 04:33:06.337844 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 292/590] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:06 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1663 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:06.351954 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-208f3005-f1c9-4287-b888-ee4c8a806edb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b9b7e8fb-6025-434d-9f37-33ff9dbde2fc"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:06.353050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-208f3005-f1c9-4287-b888-ee4c8a806edb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:06.359014 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-208f3005-f1c9-4287-b888-ee4c8a806edb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:06.359679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-208f3005-f1c9-4287-b888-ee4c8a806edb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:06.360626 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-208f3005-f1c9-4287-b888-ee4c8a806edb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:06.361319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-208f3005-f1c9-4287-b888-ee4c8a806edb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:06.673201 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1706675436", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1012993253", "security_groups": [{"name": "tempest-secgroup-smoke-497389403"}], "networks": [{"uuid": "48b70047-4f37-4bcb-9978-33a75e7a4b30"}], "block_device_mapping_v2": [{"uuid": "21e208cc-c695-4eb9-86f4-b23effc05d57", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:06.714855 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-208f3005-f1c9-4287-b888-ee4c8a806edb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.366712 Aug 13 04:33:06.715811 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 299/591] 10.222.0.13 () {62 vars in 1364 bytes} [Fri Aug 13 04:33:06 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-volume_attachments => generated 188 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:33:06.831101 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] validate_networks() for [('48b70047-4f37-4bcb-9978-33a75e7a4b30', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:33:06.930673 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1fc4a6a4-e1a7-4bce-8123-1dcbc9c14afd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:06.931833 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1fc4a6a4-e1a7-4bce-8123-1dcbc9c14afd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:06.939998 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1fc4a6a4-e1a7-4bce-8123-1dcbc9c14afd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:06.940836 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1fc4a6a4-e1a7-4bce-8123-1dcbc9c14afd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:06.942151 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1fc4a6a4-e1a7-4bce-8123-1dcbc9c14afd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:06.942979 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1fc4a6a4-e1a7-4bce-8123-1dcbc9c14afd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:07.039481 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1fc4a6a4-e1a7-4bce-8123-1dcbc9c14afd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action" status: 202 len: 0 microversion: 2.20 time: 0.112633 Aug 13 04:33:07.040547 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 300/592] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:33:06 2021] POST /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/action => generated 0 bytes in 114 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:33:07.064637 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-869975ee-0ca1-48d8-9e0c-b8f9abca10e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:07.065278 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-869975ee-0ca1-48d8-9e0c-b8f9abca10e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:07.079901 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-869975ee-0ca1-48d8-9e0c-b8f9abca10e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:07.080367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-869975ee-0ca1-48d8-9e0c-b8f9abca10e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:07.081182 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-869975ee-0ca1-48d8-9e0c-b8f9abca10e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:07.085695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-869975ee-0ca1-48d8-9e0c-b8f9abca10e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:08.046364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-869975ee-0ca1-48d8-9e0c-b8f9abca10e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:08.066599 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-869975ee-0ca1-48d8-9e0c-b8f9abca10e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:08.069310 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-869975ee-0ca1-48d8-9e0c-b8f9abca10e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:08.070827 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-869975ee-0ca1-48d8-9e0c-b8f9abca10e7 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1749 microversion: 2.20 time: 1.016119 Aug 13 04:33:08.071985 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 301/593] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:07 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1749 bytes in 1018 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:08.095695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5db2d939-9058-440d-be46-fbbf3e97cd5c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:08.097362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5db2d939-9058-440d-be46-fbbf3e97cd5c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:08.105205 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5db2d939-9058-440d-be46-fbbf3e97cd5c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:08.105799 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5db2d939-9058-440d-be46-fbbf3e97cd5c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:08.106583 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5db2d939-9058-440d-be46-fbbf3e97cd5c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:08.107018 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5db2d939-9058-440d-be46-fbbf3e97cd5c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:08.131392 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:33:08.132123 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:33:08.132286 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:33:08.133232 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:33:08.134172 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:33:08.150835 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:08.151354 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:08.156025 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:08.156534 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:08.229073 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Getting quotas for project 88885460859447cea3664074daf50abb. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:33:08.235796 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Getting quotas for user 44a59c76c3f141ea83419c098aef1aac and project 88885460859447cea3664074daf50abb. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:33:08.369314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5db2d939-9058-440d-be46-fbbf3e97cd5c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:08.378466 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5db2d939-9058-440d-be46-fbbf3e97cd5c tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1505 microversion: 2.1 time: 0.305123 Aug 13 04:33:08.381192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 302/594] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:08 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1505 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:08.388364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6a850b40-3674-471c-857b-8636ab1b43d5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:08.388994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6a850b40-3674-471c-857b-8636ab1b43d5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:08.407280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a850b40-3674-471c-857b-8636ab1b43d5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:08.407728 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a850b40-3674-471c-857b-8636ab1b43d5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:08.408511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a850b40-3674-471c-857b-8636ab1b43d5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:08.408952 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a850b40-3674-471c-857b-8636ab1b43d5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:08.437012 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:33:08.437012 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='21e208cc-c695-4eb9-86f4-b23effc05d57',volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:33:08.704572 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6a850b40-3674-471c-857b-8636ab1b43d5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:08.718045 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6a850b40-3674-471c-857b-8636ab1b43d5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.334162 Aug 13 04:33:08.720948 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 303/595] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:08 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:09.091052 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-dc3a5725-a8b2-450b-9d9c-f96d22cfd865 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:09.092452 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-dc3a5725-a8b2-450b-9d9c-f96d22cfd865 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:09.104033 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc3a5725-a8b2-450b-9d9c-f96d22cfd865 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:09.109649 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc3a5725-a8b2-450b-9d9c-f96d22cfd865 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:09.110778 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc3a5725-a8b2-450b-9d9c-f96d22cfd865 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:09.116044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dc3a5725-a8b2-450b-9d9c-f96d22cfd865 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:09.245379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-eaea2282-8506-4d5c-bf8b-d3d06c6aaffb tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 2.577134 Aug 13 04:33:09.251909 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 293/596] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:33:06 2021] POST /compute/v2.1/servers => generated 405 bytes in 2584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:33:09.278170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2d6a3333-720f-4709-bcbb-ef73c3433126 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:09.278848 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2d6a3333-720f-4709-bcbb-ef73c3433126 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:09.383056 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2d6a3333-720f-4709-bcbb-ef73c3433126 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:09.394177 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2d6a3333-720f-4709-bcbb-ef73c3433126 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1089 microversion: 2.1 time: 0.140883 Aug 13 04:33:09.395246 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 294/597] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:09 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1089 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:09.420834 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dc3a5725-a8b2-450b-9d9c-f96d22cfd865 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:09.433740 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dc3a5725-a8b2-450b-9d9c-f96d22cfd865 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:09.439546 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dc3a5725-a8b2-450b-9d9c-f96d22cfd865 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:09.443772 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dc3a5725-a8b2-450b-9d9c-f96d22cfd865 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1751 microversion: 2.20 time: 0.356928 Aug 13 04:33:09.462548 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 304/598] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:09 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1751 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:09.738840 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-50c05615-936e-4540-9f43-4d94b35eb919 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:09.740296 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-50c05615-936e-4540-9f43-4d94b35eb919 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:09.749498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-50c05615-936e-4540-9f43-4d94b35eb919 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:09.749947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-50c05615-936e-4540-9f43-4d94b35eb919 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:09.751487 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-50c05615-936e-4540-9f43-4d94b35eb919 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:09.754059 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-50c05615-936e-4540-9f43-4d94b35eb919 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:09.965038 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-50c05615-936e-4540-9f43-4d94b35eb919 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:09.973170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-50c05615-936e-4540-9f43-4d94b35eb919 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.238103 Aug 13 04:33:09.985078 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 295/599] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:09 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:10.039017 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f9020a34-31b6-455b-8208-eaf0a54d9abe tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "974210d0-2ace-4cb8-afd6-60a5838236e1"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:10.040227 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f9020a34-31b6-455b-8208-eaf0a54d9abe tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:10.047085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f9020a34-31b6-455b-8208-eaf0a54d9abe tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:10.048005 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f9020a34-31b6-455b-8208-eaf0a54d9abe tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:10.049138 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f9020a34-31b6-455b-8208-eaf0a54d9abe tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:10.049837 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f9020a34-31b6-455b-8208-eaf0a54d9abe tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:10.412432 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-897ea18f-3d6c-41b3-b48f-8e4d735ed896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:10.413978 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-897ea18f-3d6c-41b3-b48f-8e4d735ed896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:10.420298 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-897ea18f-3d6c-41b3-b48f-8e4d735ed896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:10.420994 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-897ea18f-3d6c-41b3-b48f-8e4d735ed896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:10.422027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-897ea18f-3d6c-41b3-b48f-8e4d735ed896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:10.422665 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-897ea18f-3d6c-41b3-b48f-8e4d735ed896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:10.442887 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f9020a34-31b6-455b-8208-eaf0a54d9abe tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "POST /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.408130 Aug 13 04:33:10.446055 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 305/600] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:33:10 2021] POST /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments => generated 194 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:10.498730 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f632c168-c7a4-493d-9223-1e2234c9a28f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:10.502351 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f632c168-c7a4-493d-9223-1e2234c9a28f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:10.510219 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f632c168-c7a4-493d-9223-1e2234c9a28f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:10.511098 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f632c168-c7a4-493d-9223-1e2234c9a28f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:10.512980 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f632c168-c7a4-493d-9223-1e2234c9a28f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:10.513979 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f632c168-c7a4-493d-9223-1e2234c9a28f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:10.517733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-897ea18f-3d6c-41b3-b48f-8e4d735ed896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:10.527343 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-897ea18f-3d6c-41b3-b48f-8e4d735ed896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1187 microversion: 2.1 time: 0.119766 Aug 13 04:33:10.527943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 296/601] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:10 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1187 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:10.885002 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f632c168-c7a4-493d-9223-1e2234c9a28f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:10.895149 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f632c168-c7a4-493d-9223-1e2234c9a28f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:10.898402 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f632c168-c7a4-493d-9223-1e2234c9a28f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:10.900317 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f632c168-c7a4-493d-9223-1e2234c9a28f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1751 microversion: 2.20 time: 0.419768 Aug 13 04:33:10.902288 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 306/602] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:10 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1751 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:10.993343 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e9fad673-29c5-4d9a-9d9c-58b21fd16891 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:10.994155 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e9fad673-29c5-4d9a-9d9c-58b21fd16891 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:11.002659 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e9fad673-29c5-4d9a-9d9c-58b21fd16891 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:11.003284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e9fad673-29c5-4d9a-9d9c-58b21fd16891 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:11.007475 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e9fad673-29c5-4d9a-9d9c-58b21fd16891 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:11.007475 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e9fad673-29c5-4d9a-9d9c-58b21fd16891 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:11.302047 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e9fad673-29c5-4d9a-9d9c-58b21fd16891 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:11.312257 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e9fad673-29c5-4d9a-9d9c-58b21fd16891 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.323671 Aug 13 04:33:11.314565 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 297/603] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:10 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:11.544175 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f590c60d-4b16-4aa8-afe9-1f8a3f99a10e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:11.544788 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f590c60d-4b16-4aa8-afe9-1f8a3f99a10e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:11.553598 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f590c60d-4b16-4aa8-afe9-1f8a3f99a10e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:11.554050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f590c60d-4b16-4aa8-afe9-1f8a3f99a10e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:11.558423 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f590c60d-4b16-4aa8-afe9-1f8a3f99a10e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:11.559079 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f590c60d-4b16-4aa8-afe9-1f8a3f99a10e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:11.735354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f590c60d-4b16-4aa8-afe9-1f8a3f99a10e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:11.746416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f590c60d-4b16-4aa8-afe9-1f8a3f99a10e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1205 microversion: 2.1 time: 0.205864 Aug 13 04:33:11.758452 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 307/604] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:11 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1205 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:11.918663 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a9c456a7-75e2-434f-b5c9-498913b7193c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:11.919848 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a9c456a7-75e2-434f-b5c9-498913b7193c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:11.926262 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a9c456a7-75e2-434f-b5c9-498913b7193c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:11.927023 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a9c456a7-75e2-434f-b5c9-498913b7193c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:11.928032 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a9c456a7-75e2-434f-b5c9-498913b7193c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:11.928663 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a9c456a7-75e2-434f-b5c9-498913b7193c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:12.235668 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a9c456a7-75e2-434f-b5c9-498913b7193c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:12.247392 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a9c456a7-75e2-434f-b5c9-498913b7193c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:12.249382 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a9c456a7-75e2-434f-b5c9-498913b7193c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:12.250885 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a9c456a7-75e2-434f-b5c9-498913b7193c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.336332 Aug 13 04:33:12.251635 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 298/605] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:11 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:12.334163 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-270c441f-7154-49c7-be8a-853623e2c805 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:12.335061 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-270c441f-7154-49c7-be8a-853623e2c805 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:12.343400 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-270c441f-7154-49c7-be8a-853623e2c805 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:12.344127 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-270c441f-7154-49c7-be8a-853623e2c805 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:12.345300 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-270c441f-7154-49c7-be8a-853623e2c805 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:12.345795 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-270c441f-7154-49c7-be8a-853623e2c805 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:12.672486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-270c441f-7154-49c7-be8a-853623e2c805 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:12.680681 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-270c441f-7154-49c7-be8a-853623e2c805 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.353109 Aug 13 04:33:12.691919 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 308/606] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:12 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:12.764351 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8e5cd8b6-ce93-4b59-852d-e556f347ae3e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:12.764971 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8e5cd8b6-ce93-4b59-852d-e556f347ae3e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:12.775744 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8e5cd8b6-ce93-4b59-852d-e556f347ae3e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:12.776276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8e5cd8b6-ce93-4b59-852d-e556f347ae3e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:12.777096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8e5cd8b6-ce93-4b59-852d-e556f347ae3e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:12.777569 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8e5cd8b6-ce93-4b59-852d-e556f347ae3e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:13.111366 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-8e5cd8b6-ce93-4b59-852d-e556f347ae3e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:13.129539 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8e5cd8b6-ce93-4b59-852d-e556f347ae3e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.368312 Aug 13 04:33:13.131476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 299/607] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:12 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:13.269570 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-975e0736-01c9-4e56-a3cf-a68346209bba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:13.270342 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-975e0736-01c9-4e56-a3cf-a68346209bba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:13.279988 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-975e0736-01c9-4e56-a3cf-a68346209bba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:13.282334 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-975e0736-01c9-4e56-a3cf-a68346209bba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:13.285031 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-975e0736-01c9-4e56-a3cf-a68346209bba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:13.287094 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-975e0736-01c9-4e56-a3cf-a68346209bba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:13.721925 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-6dfa6047-6055-4344-9d3f-3812aa278976 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:13.722642 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6dfa6047-6055-4344-9d3f-3812aa278976 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:13.731380 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6dfa6047-6055-4344-9d3f-3812aa278976 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:13.731748 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6dfa6047-6055-4344-9d3f-3812aa278976 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:13.732542 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6dfa6047-6055-4344-9d3f-3812aa278976 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:13.732974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6dfa6047-6055-4344-9d3f-3812aa278976 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:13.738273 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-975e0736-01c9-4e56-a3cf-a68346209bba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:13.758039 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-975e0736-01c9-4e56-a3cf-a68346209bba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:13.763610 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-975e0736-01c9-4e56-a3cf-a68346209bba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:13.768776 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-975e0736-01c9-4e56-a3cf-a68346209bba tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.503361 Aug 13 04:33:13.774693 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 309/608] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:13 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:14.154119 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ae0c1494-a5ac-4569-aa4c-f988af2268d9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:14.155550 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ae0c1494-a5ac-4569-aa4c-f988af2268d9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:14.169791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae0c1494-a5ac-4569-aa4c-f988af2268d9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:14.172306 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae0c1494-a5ac-4569-aa4c-f988af2268d9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:14.174309 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae0c1494-a5ac-4569-aa4c-f988af2268d9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:14.176311 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae0c1494-a5ac-4569-aa4c-f988af2268d9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:14.787069 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-6dfa6047-6055-4344-9d3f-3812aa278976 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:14.793415 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-6dfa6047-6055-4344-9d3f-3812aa278976 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 1.086291 Aug 13 04:33:14.803549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 300/609] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:13 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 1090 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:14.803549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-ba742aa4-2c59-4323-ac1d-391652ffaf57 req-c58b5c33-8577-4341-83ed-2dff3d58aa20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba719a9-61df-4d8d-99c1-907f97a80e8e", "tag": "1166ab58-4fa6-49a1-b301-c03b411d9dc0"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:14.803549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:14.803549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:33:14.834639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-ba742aa4-2c59-4323-ac1d-391652ffaf57 req-c58b5c33-8577-4341-83ed-2dff3d58aa20 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:14.835075 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-ba742aa4-2c59-4323-ac1d-391652ffaf57 req-c58b5c33-8577-4341-83ed-2dff3d58aa20 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:14.899036 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-ba742aa4-2c59-4323-ac1d-391652ffaf57 req-c58b5c33-8577-4341-83ed-2dff3d58aa20 service nova] Creating event network-changed:1166ab58-4fa6-49a1-b301-c03b411d9dc0 for instance 5ba719a9-61df-4d8d-99c1-907f97a80e8e on hv-cinder-75996 Aug 13 04:33:14.914563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-ba742aa4-2c59-4323-ac1d-391652ffaf57 req-c58b5c33-8577-4341-83ed-2dff3d58aa20 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.116236 Aug 13 04:33:14.921743 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 301/610] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:14 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:14.927242 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4a1534c8-db58-4b9e-a0ff-1446f9b0657e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:14.929989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4a1534c8-db58-4b9e-a0ff-1446f9b0657e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:14.963808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a1534c8-db58-4b9e-a0ff-1446f9b0657e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:14.964320 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a1534c8-db58-4b9e-a0ff-1446f9b0657e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:14.965208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a1534c8-db58-4b9e-a0ff-1446f9b0657e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:14.965669 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a1534c8-db58-4b9e-a0ff-1446f9b0657e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:15.145317 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ae0c1494-a5ac-4569-aa4c-f988af2268d9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:15.153011 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ae0c1494-a5ac-4569-aa4c-f988af2268d9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 1.009580 Aug 13 04:33:15.158825 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 310/611] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:14 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 1016 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:15.421515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4a1534c8-db58-4b9e-a0ff-1446f9b0657e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:15.450329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4a1534c8-db58-4b9e-a0ff-1446f9b0657e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:15.458247 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4a1534c8-db58-4b9e-a0ff-1446f9b0657e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:15.464475 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4a1534c8-db58-4b9e-a0ff-1446f9b0657e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.538395 Aug 13 04:33:15.465202 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 302/612] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:14 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:15.810909 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e40bda1e-6dd4-4c48-a8aa-c8f31627fc48 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:15.811786 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e40bda1e-6dd4-4c48-a8aa-c8f31627fc48 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:15.822816 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e40bda1e-6dd4-4c48-a8aa-c8f31627fc48 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:15.823495 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e40bda1e-6dd4-4c48-a8aa-c8f31627fc48 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:15.824455 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e40bda1e-6dd4-4c48-a8aa-c8f31627fc48 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:15.833642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e40bda1e-6dd4-4c48-a8aa-c8f31627fc48 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:16.173843 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8401f684-e90f-4fca-854b-fe6ca8e0cff2 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:16.174452 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8401f684-e90f-4fca-854b-fe6ca8e0cff2 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:16.186818 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8401f684-e90f-4fca-854b-fe6ca8e0cff2 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:16.187261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8401f684-e90f-4fca-854b-fe6ca8e0cff2 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:16.188048 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8401f684-e90f-4fca-854b-fe6ca8e0cff2 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:16.188472 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8401f684-e90f-4fca-854b-fe6ca8e0cff2 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:16.267333 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e40bda1e-6dd4-4c48-a8aa-c8f31627fc48 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:16.276368 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e40bda1e-6dd4-4c48-a8aa-c8f31627fc48 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.469045 Aug 13 04:33:16.298905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 311/613] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:15 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:16.487358 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-05b86f24-3251-4b37-b8f2-3b463a20a9f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:16.491843 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-05b86f24-3251-4b37-b8f2-3b463a20a9f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:16.502685 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-05b86f24-3251-4b37-b8f2-3b463a20a9f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:16.506391 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-05b86f24-3251-4b37-b8f2-3b463a20a9f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:16.507515 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-05b86f24-3251-4b37-b8f2-3b463a20a9f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:16.508389 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-05b86f24-3251-4b37-b8f2-3b463a20a9f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:16.692787 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-8401f684-e90f-4fca-854b-fe6ca8e0cff2 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:16.708937 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8401f684-e90f-4fca-854b-fe6ca8e0cff2 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.537476 Aug 13 04:33:16.724050 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 303/614] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:16 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:16.879350 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-05b86f24-3251-4b37-b8f2-3b463a20a9f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:16.910146 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-05b86f24-3251-4b37-b8f2-3b463a20a9f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:16.916802 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-05b86f24-3251-4b37-b8f2-3b463a20a9f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:16.922198 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-05b86f24-3251-4b37-b8f2-3b463a20a9f4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.441136 Aug 13 04:33:16.924446 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 312/615] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:16 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:17.294245 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e60b28dd-0f7b-4ea9-ac3c-25265d7fd6aa tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:17.295542 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e60b28dd-0f7b-4ea9-ac3c-25265d7fd6aa tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:17.302722 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e60b28dd-0f7b-4ea9-ac3c-25265d7fd6aa tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:17.303425 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e60b28dd-0f7b-4ea9-ac3c-25265d7fd6aa tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:17.304583 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e60b28dd-0f7b-4ea9-ac3c-25265d7fd6aa tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:17.305025 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e60b28dd-0f7b-4ea9-ac3c-25265d7fd6aa tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:17.561112 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e60b28dd-0f7b-4ea9-ac3c-25265d7fd6aa tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:17.573240 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e60b28dd-0f7b-4ea9-ac3c-25265d7fd6aa tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.283021 Aug 13 04:33:17.587487 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 304/616] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:17 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:17.730900 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c78a2c3f-0c33-46e5-9229-d9a4433840f5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:17.731542 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c78a2c3f-0c33-46e5-9229-d9a4433840f5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:17.745046 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c78a2c3f-0c33-46e5-9229-d9a4433840f5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:17.745270 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c78a2c3f-0c33-46e5-9229-d9a4433840f5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:17.746077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c78a2c3f-0c33-46e5-9229-d9a4433840f5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:17.748094 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c78a2c3f-0c33-46e5-9229-d9a4433840f5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:17.946331 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2e67b4b5-0241-4832-90f7-dbea9e93a305 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:17.957944 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2e67b4b5-0241-4832-90f7-dbea9e93a305 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:17.964276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e67b4b5-0241-4832-90f7-dbea9e93a305 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:17.966824 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e67b4b5-0241-4832-90f7-dbea9e93a305 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:17.967795 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e67b4b5-0241-4832-90f7-dbea9e93a305 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:17.971489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e67b4b5-0241-4832-90f7-dbea9e93a305 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:18.029871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c78a2c3f-0c33-46e5-9229-d9a4433840f5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:18.039044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c78a2c3f-0c33-46e5-9229-d9a4433840f5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.311748 Aug 13 04:33:18.042939 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 313/617] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:17 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:18.218970 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2e67b4b5-0241-4832-90f7-dbea9e93a305 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:18.228646 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2e67b4b5-0241-4832-90f7-dbea9e93a305 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:18.231674 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2e67b4b5-0241-4832-90f7-dbea9e93a305 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:18.241570 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2e67b4b5-0241-4832-90f7-dbea9e93a305 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.292357 Aug 13 04:33:18.241872 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 305/618] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:17 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:33:18.593529 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9814273c-94db-4fe7-8c17-c27f4768bbf1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:18.594530 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9814273c-94db-4fe7-8c17-c27f4768bbf1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:18.608110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9814273c-94db-4fe7-8c17-c27f4768bbf1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:18.610319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9814273c-94db-4fe7-8c17-c27f4768bbf1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:18.613302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9814273c-94db-4fe7-8c17-c27f4768bbf1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:18.614172 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9814273c-94db-4fe7-8c17-c27f4768bbf1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:18.791487 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9814273c-94db-4fe7-8c17-c27f4768bbf1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:18.801353 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9814273c-94db-4fe7-8c17-c27f4768bbf1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.212906 Aug 13 04:33:18.802279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 314/619] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:18 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:19.059501 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-953e1593-2fb9-496c-8633-e3635eaa4352 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:19.060237 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-953e1593-2fb9-496c-8633-e3635eaa4352 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:19.069585 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-953e1593-2fb9-496c-8633-e3635eaa4352 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:19.088351 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-953e1593-2fb9-496c-8633-e3635eaa4352 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:19.092448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-953e1593-2fb9-496c-8633-e3635eaa4352 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:19.100671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-953e1593-2fb9-496c-8633-e3635eaa4352 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:19.288601 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8d18d751-9f1b-4700-a986-36f328ed73dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:19.289955 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8d18d751-9f1b-4700-a986-36f328ed73dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:19.300396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8d18d751-9f1b-4700-a986-36f328ed73dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:19.300634 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8d18d751-9f1b-4700-a986-36f328ed73dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:19.302638 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8d18d751-9f1b-4700-a986-36f328ed73dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:19.303315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8d18d751-9f1b-4700-a986-36f328ed73dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:19.364855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-953e1593-2fb9-496c-8633-e3635eaa4352 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:19.373288 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-953e1593-2fb9-496c-8633-e3635eaa4352 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.317949 Aug 13 04:33:19.380949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 306/620] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:19 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:19.507740 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8d18d751-9f1b-4700-a986-36f328ed73dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:19.519829 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8d18d751-9f1b-4700-a986-36f328ed73dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:19.523049 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8d18d751-9f1b-4700-a986-36f328ed73dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:19.524467 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8d18d751-9f1b-4700-a986-36f328ed73dd tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.256807 Aug 13 04:33:19.525236 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 315/621] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:19 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:19.819231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3982aa68-62c2-46e9-a019-612f4ccc76a5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:19.820424 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3982aa68-62c2-46e9-a019-612f4ccc76a5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:19.833924 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3982aa68-62c2-46e9-a019-612f4ccc76a5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:19.834780 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3982aa68-62c2-46e9-a019-612f4ccc76a5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:19.835820 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3982aa68-62c2-46e9-a019-612f4ccc76a5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:19.836501 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3982aa68-62c2-46e9-a019-612f4ccc76a5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:20.083223 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3982aa68-62c2-46e9-a019-612f4ccc76a5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:20.108266 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3982aa68-62c2-46e9-a019-612f4ccc76a5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.290705 Aug 13 04:33:20.109599 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 307/622] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:19 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:20.391092 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a037e3bb-f5de-4334-a98b-f3689b662f37 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:20.391702 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a037e3bb-f5de-4334-a98b-f3689b662f37 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:20.409048 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a037e3bb-f5de-4334-a98b-f3689b662f37 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:20.409525 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a037e3bb-f5de-4334-a98b-f3689b662f37 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:20.410312 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a037e3bb-f5de-4334-a98b-f3689b662f37 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:20.410977 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a037e3bb-f5de-4334-a98b-f3689b662f37 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:20.543676 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1d095eb2-ead3-408e-9028-3f1dcc127c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:20.544631 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1d095eb2-ead3-408e-9028-3f1dcc127c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:20.553895 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d095eb2-ead3-408e-9028-3f1dcc127c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:20.554700 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d095eb2-ead3-408e-9028-3f1dcc127c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:20.557680 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d095eb2-ead3-408e-9028-3f1dcc127c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:20.558348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d095eb2-ead3-408e-9028-3f1dcc127c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:20.846014 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a037e3bb-f5de-4334-a98b-f3689b662f37 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:20.854737 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a037e3bb-f5de-4334-a98b-f3689b662f37 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.467146 Aug 13 04:33:20.858408 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 316/623] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:20 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:20.975516 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1d095eb2-ead3-408e-9028-3f1dcc127c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:20.995237 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1d095eb2-ead3-408e-9028-3f1dcc127c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:20.997175 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1d095eb2-ead3-408e-9028-3f1dcc127c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:20.998686 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1d095eb2-ead3-408e-9028-3f1dcc127c41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.459013 Aug 13 04:33:20.999612 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 308/624] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:20 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:21.131134 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0e66cf93-ab14-438a-9cc1-e1cb2b9cc3a2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:21.133974 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0e66cf93-ab14-438a-9cc1-e1cb2b9cc3a2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:21.151726 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0e66cf93-ab14-438a-9cc1-e1cb2b9cc3a2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:21.154669 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0e66cf93-ab14-438a-9cc1-e1cb2b9cc3a2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:21.155787 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0e66cf93-ab14-438a-9cc1-e1cb2b9cc3a2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:21.156406 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0e66cf93-ab14-438a-9cc1-e1cb2b9cc3a2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:21.440889 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0e66cf93-ab14-438a-9cc1-e1cb2b9cc3a2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:21.460691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0e66cf93-ab14-438a-9cc1-e1cb2b9cc3a2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.339060 Aug 13 04:33:21.464444 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 317/625] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:21 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:21.635409 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-286395347", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1602395338", "security_groups": [{"name": "tempest-secgroup-smoke-2048961314"}], "block_device_mapping_v2": [{"uuid": "081b3f2b-6022-4bc9-854b-03a37dbec30f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87d3a17b-ea4d-435b-9c8e-36b4c38780d2"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:21.874975 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] validate_networks() for [('87d3a17b-ea4d-435b-9c8e-36b4c38780d2', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:33:21.875155 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0b3ae1ce-34e3-45d7-9480-2c7551e0de8f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:21.875764 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0b3ae1ce-34e3-45d7-9480-2c7551e0de8f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:21.888991 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b3ae1ce-34e3-45d7-9480-2c7551e0de8f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:21.889977 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b3ae1ce-34e3-45d7-9480-2c7551e0de8f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:21.891110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b3ae1ce-34e3-45d7-9480-2c7551e0de8f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:21.891715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0b3ae1ce-34e3-45d7-9480-2c7551e0de8f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:22.606738 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0b3ae1ce-34e3-45d7-9480-2c7551e0de8f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:22.631592 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0b3ae1ce-34e3-45d7-9480-2c7551e0de8f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.759961 Aug 13 04:33:22.633520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 318/626] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:21 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:22.643514 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9a3a97e7-bb0d-4da6-a50d-4b011602f52b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:22.644130 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9a3a97e7-bb0d-4da6-a50d-4b011602f52b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:22.667366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a3a97e7-bb0d-4da6-a50d-4b011602f52b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:22.667815 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a3a97e7-bb0d-4da6-a50d-4b011602f52b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:22.671755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a3a97e7-bb0d-4da6-a50d-4b011602f52b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:22.672412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9a3a97e7-bb0d-4da6-a50d-4b011602f52b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:23.075603 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9a3a97e7-bb0d-4da6-a50d-4b011602f52b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:23.084631 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9a3a97e7-bb0d-4da6-a50d-4b011602f52b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:23.090245 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9a3a97e7-bb0d-4da6-a50d-4b011602f52b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:23.094411 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9a3a97e7-bb0d-4da6-a50d-4b011602f52b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.459669 Aug 13 04:33:23.096939 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 319/627] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:22 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:23.109634 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-33b41c75-f77e-437f-8e34-97dafb09a9e4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:23.110598 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-33b41c75-f77e-437f-8e34-97dafb09a9e4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:23.123604 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33b41c75-f77e-437f-8e34-97dafb09a9e4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:23.124345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33b41c75-f77e-437f-8e34-97dafb09a9e4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:23.127231 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33b41c75-f77e-437f-8e34-97dafb09a9e4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:23.127907 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33b41c75-f77e-437f-8e34-97dafb09a9e4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:23.253646 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:33:23.255013 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:33:23.255507 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:33:23.255918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:33:23.256332 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:33:23.271861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:23.274008 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:23.275055 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:23.279243 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:23.303586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Getting quotas for project 6f2d284955ea4d12b60ceba4f7a53e87. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:33:23.308185 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Getting quotas for user 3abce7098260457cad30873156a242d0 and project 6f2d284955ea4d12b60ceba4f7a53e87. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:33:23.423893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:33:23.426880 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='081b3f2b-6022-4bc9-854b-03a37dbec30f',volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:33:23.701938 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-33b41c75-f77e-437f-8e34-97dafb09a9e4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:23.713651 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-33b41c75-f77e-437f-8e34-97dafb09a9e4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.615199 Aug 13 04:33:23.724036 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 320/628] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:23 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:23.729636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ec29fceb-b624-469a-ac91-a65cd6853a29 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:23.730755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ec29fceb-b624-469a-ac91-a65cd6853a29 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:23.743399 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ec29fceb-b624-469a-ac91-a65cd6853a29 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:23.744240 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ec29fceb-b624-469a-ac91-a65cd6853a29 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:23.745346 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ec29fceb-b624-469a-ac91-a65cd6853a29 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:23.746054 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ec29fceb-b624-469a-ac91-a65cd6853a29 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:23.746169 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-63e03975-5c1f-4f5d-80be-56f46ba59ee4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.114886 Aug 13 04:33:23.750000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 309/629] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:33:21 2021] POST /compute/v2.1/servers => generated 406 bytes in 2120 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:33:23.768496 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-971d5153-bfff-4bdf-a7f6-716e10acec2b tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:23.770802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-971d5153-bfff-4bdf-a7f6-716e10acec2b tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:23.927074 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-971d5153-bfff-4bdf-a7f6-716e10acec2b tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:23.935352 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-971d5153-bfff-4bdf-a7f6-716e10acec2b tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1094 microversion: 2.1 time: 0.180250 Aug 13 04:33:23.939858 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 310/630] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:23 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1094 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:24.040866 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ec29fceb-b624-469a-ac91-a65cd6853a29 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:24.051880 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ec29fceb-b624-469a-ac91-a65cd6853a29 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.325844 Aug 13 04:33:24.055140 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 321/631] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:23 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:24.118323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-343575d5-0635-442c-8be5-e2b76ad3c1b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:24.119256 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-343575d5-0635-442c-8be5-e2b76ad3c1b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:24.133237 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-343575d5-0635-442c-8be5-e2b76ad3c1b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:24.133908 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-343575d5-0635-442c-8be5-e2b76ad3c1b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:24.134921 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-343575d5-0635-442c-8be5-e2b76ad3c1b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:24.135513 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-343575d5-0635-442c-8be5-e2b76ad3c1b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:24.445199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-343575d5-0635-442c-8be5-e2b76ad3c1b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:24.459564 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-343575d5-0635-442c-8be5-e2b76ad3c1b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:24.461304 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-343575d5-0635-442c-8be5-e2b76ad3c1b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:24.462627 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-343575d5-0635-442c-8be5-e2b76ad3c1b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.351040 Aug 13 04:33:24.463385 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 311/632] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:24 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:24.783941 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c58d8c59-7e27-4ca9-909e-bdd5387e0918 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:24.784822 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c58d8c59-7e27-4ca9-909e-bdd5387e0918 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:24.806188 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c58d8c59-7e27-4ca9-909e-bdd5387e0918 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:24.806659 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c58d8c59-7e27-4ca9-909e-bdd5387e0918 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:24.807491 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c58d8c59-7e27-4ca9-909e-bdd5387e0918 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:24.813323 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c58d8c59-7e27-4ca9-909e-bdd5387e0918 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:24.966950 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7d34aadc-ed05-4fb9-b559-69eb04f75264 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:24.967613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7d34aadc-ed05-4fb9-b559-69eb04f75264 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:24.997295 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7d34aadc-ed05-4fb9-b559-69eb04f75264 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:24.998338 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7d34aadc-ed05-4fb9-b559-69eb04f75264 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:25.002876 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7d34aadc-ed05-4fb9-b559-69eb04f75264 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:25.010861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7d34aadc-ed05-4fb9-b559-69eb04f75264 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:25.108211 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c58d8c59-7e27-4ca9-909e-bdd5387e0918 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:25.125173 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c58d8c59-7e27-4ca9-909e-bdd5387e0918 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.388832 Aug 13 04:33:25.126392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 322/633] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:24 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:25.134742 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9628a369-f372-404d-a01a-019553409390 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:25.135609 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9628a369-f372-404d-a01a-019553409390 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:25.147497 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9628a369-f372-404d-a01a-019553409390 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:25.148222 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9628a369-f372-404d-a01a-019553409390 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:25.153669 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9628a369-f372-404d-a01a-019553409390 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:25.154387 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9628a369-f372-404d-a01a-019553409390 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:25.165328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7d34aadc-ed05-4fb9-b559-69eb04f75264 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:25.174493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7d34aadc-ed05-4fb9-b559-69eb04f75264 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1144 microversion: 2.1 time: 0.219813 Aug 13 04:33:25.188774 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 312/634] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:24 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1144 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:25.470059 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9628a369-f372-404d-a01a-019553409390 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:25.482954 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c0ddca9d-42d4-48b5-9630-919e88599616 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:25.483577 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c0ddca9d-42d4-48b5-9630-919e88599616 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:25.484332 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9628a369-f372-404d-a01a-019553409390 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.356717 Aug 13 04:33:25.490227 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 323/635] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:25 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:25.522678 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c0ddca9d-42d4-48b5-9630-919e88599616 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:25.523126 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c0ddca9d-42d4-48b5-9630-919e88599616 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:25.523943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c0ddca9d-42d4-48b5-9630-919e88599616 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:25.524358 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c0ddca9d-42d4-48b5-9630-919e88599616 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:25.651266 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-499888a6-f5a1-4e38-9afa-4bb024528849 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:25.652170 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-499888a6-f5a1-4e38-9afa-4bb024528849 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:25.658571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-499888a6-f5a1-4e38-9afa-4bb024528849 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:25.659362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-499888a6-f5a1-4e38-9afa-4bb024528849 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:25.661220 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-499888a6-f5a1-4e38-9afa-4bb024528849 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:25.661974 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-499888a6-f5a1-4e38-9afa-4bb024528849 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:25.771254 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-499888a6-f5a1-4e38-9afa-4bb024528849 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lazy-loading 'services' on Instance uuid 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:33:25.978523 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c0ddca9d-42d4-48b5-9630-919e88599616 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:26.000901 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c0ddca9d-42d4-48b5-9630-919e88599616 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:26.004031 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-499888a6-f5a1-4e38-9afa-4bb024528849 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "DELETE /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments/974210d0-2ace-4cb8-afd6-60a5838236e1" status: 202 len: 0 microversion: 2.1 time: 0.355033 Aug 13 04:33:26.010500 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 324/636] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:33:25 2021] DELETE /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments/974210d0-2ace-4cb8-afd6-60a5838236e1 => generated 0 bytes in 363 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:33:26.015822 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c0ddca9d-42d4-48b5-9630-919e88599616 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:26.017306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c0ddca9d-42d4-48b5-9630-919e88599616 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.538434 Aug 13 04:33:26.024669 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 313/637] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:25 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 546 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:33:26.038975 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-064cc5c5-285a-40d2-a12a-3dd589aeec93 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:26.042674 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-064cc5c5-285a-40d2-a12a-3dd589aeec93 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:26.058576 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-064cc5c5-285a-40d2-a12a-3dd589aeec93 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:26.061075 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-064cc5c5-285a-40d2-a12a-3dd589aeec93 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:26.062132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-064cc5c5-285a-40d2-a12a-3dd589aeec93 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:26.064527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-064cc5c5-285a-40d2-a12a-3dd589aeec93 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:26.158989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f7ed6170-0dc0-47eb-a4ac-ffe415e96b69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:26.161055 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f7ed6170-0dc0-47eb-a4ac-ffe415e96b69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:26.173381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f7ed6170-0dc0-47eb-a4ac-ffe415e96b69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:26.174343 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-064cc5c5-285a-40d2-a12a-3dd589aeec93 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.156454 Aug 13 04:33:26.174955 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f7ed6170-0dc0-47eb-a4ac-ffe415e96b69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:26.177597 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f7ed6170-0dc0-47eb-a4ac-ffe415e96b69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:26.178510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f7ed6170-0dc0-47eb-a4ac-ffe415e96b69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:26.182277 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 325/638] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:33:26 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments => generated 197 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:26.198306 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4f695448-6d17-4ce0-82b9-154900b71eac tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:26.209085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4f695448-6d17-4ce0-82b9-154900b71eac tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:26.243121 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4f695448-6d17-4ce0-82b9-154900b71eac tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:26.243499 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4f695448-6d17-4ce0-82b9-154900b71eac tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:26.251441 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4f695448-6d17-4ce0-82b9-154900b71eac tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:26.279118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4f695448-6d17-4ce0-82b9-154900b71eac tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:26.525017 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4f695448-6d17-4ce0-82b9-154900b71eac tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:26.560950 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4f695448-6d17-4ce0-82b9-154900b71eac tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1136 microversion: 2.1 time: 0.366098 Aug 13 04:33:26.572358 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 326/639] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:26 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1136 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:26.572358 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f0e83c3e-148c-429e-8195-cb611ebd98cf tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:26.572358 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f0e83c3e-148c-429e-8195-cb611ebd98cf tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:26.575373 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f0e83c3e-148c-429e-8195-cb611ebd98cf tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:26.575899 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f0e83c3e-148c-429e-8195-cb611ebd98cf tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:26.576790 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f0e83c3e-148c-429e-8195-cb611ebd98cf tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:26.577309 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f0e83c3e-148c-429e-8195-cb611ebd98cf tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:26.672339 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f7ed6170-0dc0-47eb-a4ac-ffe415e96b69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:26.681284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f7ed6170-0dc0-47eb-a4ac-ffe415e96b69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.541172 Aug 13 04:33:26.692281 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 314/640] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:26 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:26.762818 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f0e83c3e-148c-429e-8195-cb611ebd98cf tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:26.779445 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f0e83c3e-148c-429e-8195-cb611ebd98cf tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.216268 Aug 13 04:33:26.780869 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 327/641] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:26 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:27.043260 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-487ddc58-ff88-4536-b4e2-e97dd9d282e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:27.044046 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-487ddc58-ff88-4536-b4e2-e97dd9d282e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:27.056528 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-487ddc58-ff88-4536-b4e2-e97dd9d282e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:27.057384 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-487ddc58-ff88-4536-b4e2-e97dd9d282e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:27.058452 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-487ddc58-ff88-4536-b4e2-e97dd9d282e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:27.058989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-487ddc58-ff88-4536-b4e2-e97dd9d282e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:27.195359 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e570a71d-bc6c-43a0-afd9-a3fecf789f48 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:27.197520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e570a71d-bc6c-43a0-afd9-a3fecf789f48 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:27.205172 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e570a71d-bc6c-43a0-afd9-a3fecf789f48 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:27.206036 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e570a71d-bc6c-43a0-afd9-a3fecf789f48 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:27.208612 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e570a71d-bc6c-43a0-afd9-a3fecf789f48 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:27.209313 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e570a71d-bc6c-43a0-afd9-a3fecf789f48 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:27.245644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e570a71d-bc6c-43a0-afd9-a3fecf789f48 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055961 Aug 13 04:33:27.250974 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 328/642] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:33:27 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:33:27.293662 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-487ddc58-ff88-4536-b4e2-e97dd9d282e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:27.315508 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-487ddc58-ff88-4536-b4e2-e97dd9d282e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:27.318153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-487ddc58-ff88-4536-b4e2-e97dd9d282e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:27.319588 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-487ddc58-ff88-4536-b4e2-e97dd9d282e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.280637 Aug 13 04:33:27.330363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 315/643] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:27 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:27.580627 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-03b7bb7b-2baa-48d5-b8e5-e1a61e3f52e7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:27.593126 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-03b7bb7b-2baa-48d5-b8e5-e1a61e3f52e7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:27.616514 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03b7bb7b-2baa-48d5-b8e5-e1a61e3f52e7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:27.616972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03b7bb7b-2baa-48d5-b8e5-e1a61e3f52e7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:27.617790 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03b7bb7b-2baa-48d5-b8e5-e1a61e3f52e7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:27.618225 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03b7bb7b-2baa-48d5-b8e5-e1a61e3f52e7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:27.699547 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1a3d9578-6ea2-4baa-b102-b25914f9d577 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:27.700115 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-03b7bb7b-2baa-48d5-b8e5-e1a61e3f52e7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:27.700415 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1a3d9578-6ea2-4baa-b102-b25914f9d577 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:27.712131 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1a3d9578-6ea2-4baa-b102-b25914f9d577 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:27.712583 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1a3d9578-6ea2-4baa-b102-b25914f9d577 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:27.713366 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1a3d9578-6ea2-4baa-b102-b25914f9d577 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:27.713835 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1a3d9578-6ea2-4baa-b102-b25914f9d577 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:27.716466 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-03b7bb7b-2baa-48d5-b8e5-e1a61e3f52e7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1192 microversion: 2.1 time: 0.139362 Aug 13 04:33:27.717254 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 329/644] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:27 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1192 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:27.796001 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-06f5e05c-6505-4af8-ab98-ed292c8aff7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:27.796616 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-06f5e05c-6505-4af8-ab98-ed292c8aff7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:27.808755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-06f5e05c-6505-4af8-ab98-ed292c8aff7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:27.809223 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-06f5e05c-6505-4af8-ab98-ed292c8aff7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:27.810077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-06f5e05c-6505-4af8-ab98-ed292c8aff7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:27.810504 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-06f5e05c-6505-4af8-ab98-ed292c8aff7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:27.910619 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1a3d9578-6ea2-4baa-b102-b25914f9d577 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:27.919131 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1a3d9578-6ea2-4baa-b102-b25914f9d577 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.223876 Aug 13 04:33:27.961527 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 316/645] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:27 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:28.065723 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-06f5e05c-6505-4af8-ab98-ed292c8aff7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:28.074682 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-06f5e05c-6505-4af8-ab98-ed292c8aff7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.282255 Aug 13 04:33:28.075446 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 330/646] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:27 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:28.259120 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2c958c79-4744-47c5-af0f-d0d9b92d9d1a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:28.271624 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2c958c79-4744-47c5-af0f-d0d9b92d9d1a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:28.278435 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c958c79-4744-47c5-af0f-d0d9b92d9d1a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:28.279204 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c958c79-4744-47c5-af0f-d0d9b92d9d1a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:28.282237 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c958c79-4744-47c5-af0f-d0d9b92d9d1a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:28.282962 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c958c79-4744-47c5-af0f-d0d9b92d9d1a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:28.321317 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2c958c79-4744-47c5-af0f-d0d9b92d9d1a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065740 Aug 13 04:33:28.322342 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 317/647] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:33:28 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments => generated 197 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:28.340992 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-de3407d3-1016-468f-aaa0-3166010007b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:28.342490 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-de3407d3-1016-468f-aaa0-3166010007b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:28.352644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de3407d3-1016-468f-aaa0-3166010007b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:28.353475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de3407d3-1016-468f-aaa0-3166010007b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:28.356332 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de3407d3-1016-468f-aaa0-3166010007b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:28.357249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de3407d3-1016-468f-aaa0-3166010007b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:28.545522 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-de3407d3-1016-468f-aaa0-3166010007b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:28.555102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-de3407d3-1016-468f-aaa0-3166010007b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:28.556677 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-de3407d3-1016-468f-aaa0-3166010007b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:28.578220 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-de3407d3-1016-468f-aaa0-3166010007b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.243479 Aug 13 04:33:28.579178 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 331/648] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:28 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:28.745997 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b4e18a30-6356-4cf7-b630-51123a8053da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:28.746691 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b4e18a30-6356-4cf7-b630-51123a8053da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:28.753345 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4e18a30-6356-4cf7-b630-51123a8053da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:28.754563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4e18a30-6356-4cf7-b630-51123a8053da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:28.755284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4e18a30-6356-4cf7-b630-51123a8053da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:28.755704 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4e18a30-6356-4cf7-b630-51123a8053da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:28.859180 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b4e18a30-6356-4cf7-b630-51123a8053da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:28.872111 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b4e18a30-6356-4cf7-b630-51123a8053da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1192 microversion: 2.1 time: 0.142008 Aug 13 04:33:28.875066 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 318/649] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:28 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1192 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:28.939921 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-53d56430-c88b-455f-a75e-51e5b3de5a54 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:28.940832 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-53d56430-c88b-455f-a75e-51e5b3de5a54 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:28.956476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-53d56430-c88b-455f-a75e-51e5b3de5a54 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:28.956476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-53d56430-c88b-455f-a75e-51e5b3de5a54 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:28.956476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-53d56430-c88b-455f-a75e-51e5b3de5a54 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:28.956476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-53d56430-c88b-455f-a75e-51e5b3de5a54 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:29.092292 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2c932535-74fd-4382-ba38-e9a4cbc89e09 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:29.092916 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2c932535-74fd-4382-ba38-e9a4cbc89e09 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:29.108027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c932535-74fd-4382-ba38-e9a4cbc89e09 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:29.108027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c932535-74fd-4382-ba38-e9a4cbc89e09 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:29.108027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c932535-74fd-4382-ba38-e9a4cbc89e09 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:29.108027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c932535-74fd-4382-ba38-e9a4cbc89e09 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:29.141601 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-53d56430-c88b-455f-a75e-51e5b3de5a54 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:29.149703 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-53d56430-c88b-455f-a75e-51e5b3de5a54 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.213788 Aug 13 04:33:29.150767 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 332/650] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:28 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:29.274623 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2c932535-74fd-4382-ba38-e9a4cbc89e09 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:29.281976 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2c932535-74fd-4382-ba38-e9a4cbc89e09 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1272 microversion: 2.1 time: 0.194444 Aug 13 04:33:29.282629 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 319/651] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:29 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1272 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:29.334248 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7ce7e71a-bda1-4947-b79b-0da5f024f30d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:29.335243 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7ce7e71a-bda1-4947-b79b-0da5f024f30d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:29.341377 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ce7e71a-bda1-4947-b79b-0da5f024f30d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:29.342047 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ce7e71a-bda1-4947-b79b-0da5f024f30d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:29.343005 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ce7e71a-bda1-4947-b79b-0da5f024f30d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:29.343600 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ce7e71a-bda1-4947-b79b-0da5f024f30d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:29.375786 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7ce7e71a-bda1-4947-b79b-0da5f024f30d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046470 Aug 13 04:33:29.380637 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 333/652] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:33:29 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:29.596665 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f120065c-25ce-4b4d-9669-fa200986f72f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:29.598529 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f120065c-25ce-4b4d-9669-fa200986f72f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:29.605377 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f120065c-25ce-4b4d-9669-fa200986f72f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:29.605853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f120065c-25ce-4b4d-9669-fa200986f72f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:29.606664 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f120065c-25ce-4b4d-9669-fa200986f72f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:29.607236 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f120065c-25ce-4b4d-9669-fa200986f72f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:29.757198 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f120065c-25ce-4b4d-9669-fa200986f72f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:29.766967 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f120065c-25ce-4b4d-9669-fa200986f72f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:29.768490 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f120065c-25ce-4b4d-9669-fa200986f72f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:29.771263 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f120065c-25ce-4b4d-9669-fa200986f72f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.178039 Aug 13 04:33:29.771499 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 320/653] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:29 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:29.857377 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-05cdb43d-8302-4d07-b852-de259ce40cea tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Action: 'create', calling method: .version_select at 0x7fc45ff303a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1628648224"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:29.889898 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9dc3e334-3bcb-4db0-a6c8-6aa0e89b64c4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:29.890617 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9dc3e334-3bcb-4db0-a6c8-6aa0e89b64c4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:29.891724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-05cdb43d-8302-4d07-b852-de259ce40cea tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Getting quotas for project c41ff29303444fd0820593792b37e277. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:33:29.898076 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-05cdb43d-8302-4d07-b852-de259ce40cea tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Getting quotas for user 576a9c2014d242ff8f25b3df690bb518 and project c41ff29303444fd0820593792b37e277. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:33:29.898305 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9dc3e334-3bcb-4db0-a6c8-6aa0e89b64c4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:29.898703 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9dc3e334-3bcb-4db0-a6c8-6aa0e89b64c4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:29.899729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9dc3e334-3bcb-4db0-a6c8-6aa0e89b64c4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:29.900233 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9dc3e334-3bcb-4db0-a6c8-6aa0e89b64c4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.007000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9dc3e334-3bcb-4db0-a6c8-6aa0e89b64c4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:30.016346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9dc3e334-3bcb-4db0-a6c8-6aa0e89b64c4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1192 microversion: 2.1 time: 0.129400 Aug 13 04:33:30.026191 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 321/654] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:29 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1192 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:30.064046 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-05cdb43d-8302-4d07-b852-de259ce40cea tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Getting quotas for project c41ff29303444fd0820593792b37e277. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:33:30.068623 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-05cdb43d-8302-4d07-b852-de259ce40cea tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Getting quotas for user 576a9c2014d242ff8f25b3df690bb518 and project c41ff29303444fd0820593792b37e277. Resources: {'key_pairs'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:33:30.083450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-05cdb43d-8302-4d07-b852-de259ce40cea tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.230151 Aug 13 04:33:30.084307 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 334/655] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Aug 13 04:33:29 2021] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:30.133287 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-699664508", "imageRef": "aea58b1b-1d2d-41a7-a990-0afde3ba9020", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1628648224", "networks": [{"uuid": "cc773a2e-a6e4-4037-a278-1599b19ecd84"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:30.167299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5e34f38d-92c6-4ab4-b1df-1d8b1b8925fe tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:30.168193 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5e34f38d-92c6-4ab4-b1df-1d8b1b8925fe tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:30.175051 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5e34f38d-92c6-4ab4-b1df-1d8b1b8925fe tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.175890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5e34f38d-92c6-4ab4-b1df-1d8b1b8925fe tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.176850 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5e34f38d-92c6-4ab4-b1df-1d8b1b8925fe tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.177396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5e34f38d-92c6-4ab4-b1df-1d8b1b8925fe tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.187160 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] validate_networks() for [('cc773a2e-a6e4-4037-a278-1599b19ecd84', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:33:30.407095 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5e34f38d-92c6-4ab4-b1df-1d8b1b8925fe tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:30.415610 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5e34f38d-92c6-4ab4-b1df-1d8b1b8925fe tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1501 microversion: 2.1 time: 0.252040 Aug 13 04:33:30.416439 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 335/656] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:30 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1501 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:30.421188 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6ca78d74-44e5-49d3-8634-a5536542f169 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:30.422165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6ca78d74-44e5-49d3-8634-a5536542f169 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:30.432123 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ca78d74-44e5-49d3-8634-a5536542f169 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.433009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ca78d74-44e5-49d3-8634-a5536542f169 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.434114 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ca78d74-44e5-49d3-8634-a5536542f169 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.434664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ca78d74-44e5-49d3-8634-a5536542f169 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.690385 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6ca78d74-44e5-49d3-8634-a5536542f169 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:30.698178 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6ca78d74-44e5-49d3-8634-a5536542f169 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.280343 Aug 13 04:33:30.698743 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 336/657] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:30 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:30.703153 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-10bf3f1b-1972-4a75-8868-06e8182a6b22 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:30.704185 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-10bf3f1b-1972-4a75-8868-06e8182a6b22 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:30.709892 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-10bf3f1b-1972-4a75-8868-06e8182a6b22 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.710836 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-10bf3f1b-1972-4a75-8868-06e8182a6b22 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.711685 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-10bf3f1b-1972-4a75-8868-06e8182a6b22 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.712123 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-10bf3f1b-1972-4a75-8868-06e8182a6b22 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.745874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-10bf3f1b-1972-4a75-8868-06e8182a6b22 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046046 Aug 13 04:33:30.749829 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 337/658] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:33:30 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:30.751286 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-692efa86-a146-4dd8-9fc5-48f7d67dc65f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4df73e7d-a5f0-42e5-9f87-16eff7d64e13"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:30.752359 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-692efa86-a146-4dd8-9fc5-48f7d67dc65f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:30.759438 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-692efa86-a146-4dd8-9fc5-48f7d67dc65f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.759888 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-692efa86-a146-4dd8-9fc5-48f7d67dc65f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.760717 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-692efa86-a146-4dd8-9fc5-48f7d67dc65f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.761157 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-692efa86-a146-4dd8-9fc5-48f7d67dc65f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.787038 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-692efa86-a146-4dd8-9fc5-48f7d67dc65f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] HTTP exception thrown: Cannot 'attach_volume' instance 25395051-723e-4a2e-a22c-7892a0285098 while it is in vm_state rescued Aug 13 04:33:30.787728 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-692efa86-a146-4dd8-9fc5-48f7d67dc65f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Returning 409 to user: Cannot 'attach_volume' instance 25395051-723e-4a2e-a22c-7892a0285098 while it is in vm_state rescued {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:33:30.788537 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-692efa86-a146-4dd8-9fc5-48f7d67dc65f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041031 Aug 13 04:33:30.789090 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 338/659] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:33:30 2021] POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 13 04:33:30.796905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1be9cba9-c4bf-44ed-b4e9-478ac99fcbdc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:30.797556 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1be9cba9-c4bf-44ed-b4e9-478ac99fcbdc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:30.804846 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1be9cba9-c4bf-44ed-b4e9-478ac99fcbdc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.805323 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1be9cba9-c4bf-44ed-b4e9-478ac99fcbdc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.806221 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1be9cba9-c4bf-44ed-b4e9-478ac99fcbdc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.806662 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1be9cba9-c4bf-44ed-b4e9-478ac99fcbdc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.935301 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:33:30.935916 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:33:30.936395 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:33:30.936802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:33:30.937212 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:33:30.947708 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.948071 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.948885 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:30.949310 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:30.968105 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Getting quotas for project c41ff29303444fd0820593792b37e277. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:33:30.971942 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Getting quotas for user 576a9c2014d242ff8f25b3df690bb518 and project c41ff29303444fd0820593792b37e277. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:33:30.982573 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:33:30.984636 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='aea58b1b-1d2d-41a7-a990-0afde3ba9020',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:33:31.012676 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1be9cba9-c4bf-44ed-b4e9-478ac99fcbdc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:31.021942 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1be9cba9-c4bf-44ed-b4e9-478ac99fcbdc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:31.023435 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1be9cba9-c4bf-44ed-b4e9-478ac99fcbdc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:31.024574 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1be9cba9-c4bf-44ed-b4e9-478ac99fcbdc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.231151 Aug 13 04:33:31.025117 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 339/660] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:30 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:31.029564 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-46f6a6f9-c46c-4ef0-bd83-c7fd6c833655 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:31.030254 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-46f6a6f9-c46c-4ef0-bd83-c7fd6c833655 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:31.038740 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46f6a6f9-c46c-4ef0-bd83-c7fd6c833655 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:31.039082 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7ccf019c-ac56-468a-8d3a-cf42d8f3d375 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.908926 Aug 13 04:33:31.039214 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46f6a6f9-c46c-4ef0-bd83-c7fd6c833655 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:31.039639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 322/661] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:33:30 2021] POST /compute/v2.1/servers => generated 380 bytes in 911 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:33:31.039936 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46f6a6f9-c46c-4ef0-bd83-c7fd6c833655 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:31.040533 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46f6a6f9-c46c-4ef0-bd83-c7fd6c833655 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:31.044455 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-91aa32f9-4033-4800-a607-1d85bdcc3abb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:31.045068 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-91aa32f9-4033-4800-a607-1d85bdcc3abb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:31.052060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-91aa32f9-4033-4800-a607-1d85bdcc3abb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:31.052431 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-91aa32f9-4033-4800-a607-1d85bdcc3abb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:31.053390 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-91aa32f9-4033-4800-a607-1d85bdcc3abb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:31.054001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-91aa32f9-4033-4800-a607-1d85bdcc3abb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:31.135660 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-46f6a6f9-c46c-4ef0-bd83-c7fd6c833655 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/action" status: 202 len: 0 microversion: 2.1 time: 0.108922 Aug 13 04:33:31.137382 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 340/662] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:33:31 2021] POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/action => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:33:31.141980 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-91aa32f9-4033-4800-a607-1d85bdcc3abb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:31.148433 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8b161ccc-b279-4aa4-94af-3912a4e9c3c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:31.149161 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8b161ccc-b279-4aa4-94af-3912a4e9c3c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:31.160270 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-91aa32f9-4033-4800-a607-1d85bdcc3abb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1210 microversion: 2.1 time: 0.119100 Aug 13 04:33:31.163336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 323/663] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:31 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1210 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:31.169830 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-42d59dbf-a17b-40d4-ae77-e9178afb8024 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:31.173066 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-42d59dbf-a17b-40d4-ae77-e9178afb8024 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:31.185020 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-42d59dbf-a17b-40d4-ae77-e9178afb8024 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:31.185550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-42d59dbf-a17b-40d4-ae77-e9178afb8024 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:31.186583 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-42d59dbf-a17b-40d4-ae77-e9178afb8024 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:31.187096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-42d59dbf-a17b-40d4-ae77-e9178afb8024 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:31.220214 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8b161ccc-b279-4aa4-94af-3912a4e9c3c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:31.229543 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8b161ccc-b279-4aa4-94af-3912a4e9c3c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1258 microversion: 2.1 time: 0.090760 Aug 13 04:33:31.231088 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 341/664] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:31 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1258 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:31.720165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-01c08fab-6c90-4c7d-8f78-929263916ffa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:31.721322 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-01c08fab-6c90-4c7d-8f78-929263916ffa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:31.729590 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01c08fab-6c90-4c7d-8f78-929263916ffa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:31.730131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01c08fab-6c90-4c7d-8f78-929263916ffa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:31.731077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01c08fab-6c90-4c7d-8f78-929263916ffa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:31.731620 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-01c08fab-6c90-4c7d-8f78-929263916ffa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:31.736030 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-42d59dbf-a17b-40d4-ae77-e9178afb8024 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:31.751360 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-42d59dbf-a17b-40d4-ae77-e9178afb8024 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.586688 Aug 13 04:33:31.752651 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 324/665] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:31 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 589 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:31.758316 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e1cfa623-c681-4e75-af22-ded6b477c947 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:31.764386 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e1cfa623-c681-4e75-af22-ded6b477c947 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:31.772020 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e1cfa623-c681-4e75-af22-ded6b477c947 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:31.772839 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e1cfa623-c681-4e75-af22-ded6b477c947 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:31.774145 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e1cfa623-c681-4e75-af22-ded6b477c947 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:31.775145 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e1cfa623-c681-4e75-af22-ded6b477c947 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:31.812130 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e1cfa623-c681-4e75-af22-ded6b477c947 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058135 Aug 13 04:33:31.812850 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 325/666] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:33:31 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:33:32.044405 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f4780214-af2c-49b4-abb6-67cd8fa099ff tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:32.045235 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f4780214-af2c-49b4-abb6-67cd8fa099ff tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:32.053925 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4780214-af2c-49b4-abb6-67cd8fa099ff tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:32.054381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4780214-af2c-49b4-abb6-67cd8fa099ff tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:32.055174 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4780214-af2c-49b4-abb6-67cd8fa099ff tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:32.055612 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f4780214-af2c-49b4-abb6-67cd8fa099ff tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:32.079845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-01c08fab-6c90-4c7d-8f78-929263916ffa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:32.089069 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-01c08fab-6c90-4c7d-8f78-929263916ffa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.376795 Aug 13 04:33:32.103811 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 342/667] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:31 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:32.179044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-998d9e62-5de4-4a8c-9e64-52c7be6c2a9c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:32.181550 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-998d9e62-5de4-4a8c-9e64-52c7be6c2a9c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:32.189253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-998d9e62-5de4-4a8c-9e64-52c7be6c2a9c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:32.190121 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-998d9e62-5de4-4a8c-9e64-52c7be6c2a9c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:32.192226 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-998d9e62-5de4-4a8c-9e64-52c7be6c2a9c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:32.194051 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-998d9e62-5de4-4a8c-9e64-52c7be6c2a9c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:32.416940 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f4780214-af2c-49b4-abb6-67cd8fa099ff tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:32.428539 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f4780214-af2c-49b4-abb6-67cd8fa099ff tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:32.430204 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f4780214-af2c-49b4-abb6-67cd8fa099ff tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:32.431613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f4780214-af2c-49b4-abb6-67cd8fa099ff tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.391394 Aug 13 04:33:32.432651 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 326/668] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:32 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:33:32.438950 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-efeeaa5f-c22e-4765-8ddf-5aab4ad45cc9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:32.440569 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-efeeaa5f-c22e-4765-8ddf-5aab4ad45cc9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:32.450169 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-efeeaa5f-c22e-4765-8ddf-5aab4ad45cc9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:32.450782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-efeeaa5f-c22e-4765-8ddf-5aab4ad45cc9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:32.451666 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-efeeaa5f-c22e-4765-8ddf-5aab4ad45cc9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:32.452209 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-efeeaa5f-c22e-4765-8ddf-5aab4ad45cc9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:32.560814 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-efeeaa5f-c22e-4765-8ddf-5aab4ad45cc9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:32.573265 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-efeeaa5f-c22e-4765-8ddf-5aab4ad45cc9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1316 microversion: 2.1 time: 0.138730 Aug 13 04:33:32.573419 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-998d9e62-5de4-4a8c-9e64-52c7be6c2a9c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:32.574290 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 327/669] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:32 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1316 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:32.586189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-998d9e62-5de4-4a8c-9e64-52c7be6c2a9c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.411189 Aug 13 04:33:32.586957 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 343/670] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:32 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:32.772255 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7281854e-0aea-438c-83df-52b8728f29c2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:32.772520 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7281854e-0aea-438c-83df-52b8728f29c2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:32.781542 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7281854e-0aea-438c-83df-52b8728f29c2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:32.782330 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7281854e-0aea-438c-83df-52b8728f29c2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:32.785092 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7281854e-0aea-438c-83df-52b8728f29c2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:32.786346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7281854e-0aea-438c-83df-52b8728f29c2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:33.059962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8cf633ca-8868-43ad-9243-eff9599923c1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:33.060751 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8cf633ca-8868-43ad-9243-eff9599923c1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:33.073953 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8cf633ca-8868-43ad-9243-eff9599923c1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:33.079852 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8cf633ca-8868-43ad-9243-eff9599923c1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:33.081168 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8cf633ca-8868-43ad-9243-eff9599923c1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:33.082658 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8cf633ca-8868-43ad-9243-eff9599923c1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:33.157833 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8cf633ca-8868-43ad-9243-eff9599923c1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:33:33.170725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7281854e-0aea-438c-83df-52b8728f29c2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:33.178723 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7281854e-0aea-438c-83df-52b8728f29c2 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.411391 Aug 13 04:33:33.179306 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 328/671] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:32 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:33.192363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a7c40e54-747d-4199-b53c-cd8fd703288d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:33.192622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a7c40e54-747d-4199-b53c-cd8fd703288d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:33.212356 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7c40e54-747d-4199-b53c-cd8fd703288d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:33.214110 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7c40e54-747d-4199-b53c-cd8fd703288d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:33.215458 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7c40e54-747d-4199-b53c-cd8fd703288d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:33.216077 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7c40e54-747d-4199-b53c-cd8fd703288d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:33.348514 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8cf633ca-8868-43ad-9243-eff9599923c1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "DELETE /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 204 len: 0 microversion: 2.1 time: 0.292037 Aug 13 04:33:33.352018 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 344/672] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:33:33 2021] DELETE /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 0 bytes in 297 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:33:33.365840 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f9331446-70a0-452e-8651-9b95c14461a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:33.366924 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f9331446-70a0-452e-8651-9b95c14461a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:33.374684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f9331446-70a0-452e-8651-9b95c14461a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:33.376139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f9331446-70a0-452e-8651-9b95c14461a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:33.378175 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f9331446-70a0-452e-8651-9b95c14461a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:33.382738 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f9331446-70a0-452e-8651-9b95c14461a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:33.559496 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a7c40e54-747d-4199-b53c-cd8fd703288d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:33.568667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a7c40e54-747d-4199-b53c-cd8fd703288d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.388317 Aug 13 04:33:33.575848 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 329/673] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:33 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:33.580929 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-64109475-7364-4876-96cb-38fb08902d75 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:33.585855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-64109475-7364-4876-96cb-38fb08902d75 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:33.601148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-64109475-7364-4876-96cb-38fb08902d75 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:33.605959 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-64109475-7364-4876-96cb-38fb08902d75 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:33.607029 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-64109475-7364-4876-96cb-38fb08902d75 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:33.607644 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-64109475-7364-4876-96cb-38fb08902d75 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:33.830021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f9331446-70a0-452e-8651-9b95c14461a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:33.848222 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f9331446-70a0-452e-8651-9b95c14461a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.491930 Aug 13 04:33:33.858354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 345/674] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:33 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 503 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:33.863373 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-28b9e36f-d2e9-4843-ab01-2e3d170bef3e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:33.864004 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-28b9e36f-d2e9-4843-ab01-2e3d170bef3e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:33.884127 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-28b9e36f-d2e9-4843-ab01-2e3d170bef3e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:33.884768 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-28b9e36f-d2e9-4843-ab01-2e3d170bef3e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:33.885829 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-28b9e36f-d2e9-4843-ab01-2e3d170bef3e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:33.886233 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-28b9e36f-d2e9-4843-ab01-2e3d170bef3e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:34.095694 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-64109475-7364-4876-96cb-38fb08902d75 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:34.111452 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-64109475-7364-4876-96cb-38fb08902d75 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:34.116529 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-64109475-7364-4876-96cb-38fb08902d75 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:34.122919 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-64109475-7364-4876-96cb-38fb08902d75 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.544451 Aug 13 04:33:34.125073 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 330/675] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:33 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 548 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:34.135630 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5d3379d2-5e33-4e6c-b9e2-96b48a5153ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:34.138384 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5d3379d2-5e33-4e6c-b9e2-96b48a5153ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:34.155923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d3379d2-5e33-4e6c-b9e2-96b48a5153ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:34.156748 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d3379d2-5e33-4e6c-b9e2-96b48a5153ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:34.161870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d3379d2-5e33-4e6c-b9e2-96b48a5153ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:34.170425 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d3379d2-5e33-4e6c-b9e2-96b48a5153ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:34.276655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-28b9e36f-d2e9-4843-ab01-2e3d170bef3e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:34.287613 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-28b9e36f-d2e9-4843-ab01-2e3d170bef3e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.428204 Aug 13 04:33:34.289274 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 346/676] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:33 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:34.307414 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-f92705d8-7c33-4843-9f12-eb3a6e0df6c8 req-e372754a-d930-4854-98c6-4e3fbf2bb750 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e0099a-7c38-4609-a63f-fee3baa6db7a", "tag": "a6019955-dfeb-42fd-bf68-d1fac8198ecb"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:34.309297 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:34.309297 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:33:34.320874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-f92705d8-7c33-4843-9f12-eb3a6e0df6c8 req-e372754a-d930-4854-98c6-4e3fbf2bb750 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:34.321569 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-f92705d8-7c33-4843-9f12-eb3a6e0df6c8 req-e372754a-d930-4854-98c6-4e3fbf2bb750 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:34.350897 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-f92705d8-7c33-4843-9f12-eb3a6e0df6c8 req-e372754a-d930-4854-98c6-4e3fbf2bb750 service nova] Creating event network-changed:a6019955-dfeb-42fd-bf68-d1fac8198ecb for instance 04e0099a-7c38-4609-a63f-fee3baa6db7a on hv-cinder-75996 Aug 13 04:33:34.355573 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-f92705d8-7c33-4843-9f12-eb3a6e0df6c8 req-e372754a-d930-4854-98c6-4e3fbf2bb750 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064678 Aug 13 04:33:34.356183 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 347/677] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:34.361133 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-415dd0a5-6c87-4f34-a424-bd81c5e65312 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:34.361869 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-415dd0a5-6c87-4f34-a424-bd81c5e65312 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:34.368987 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-415dd0a5-6c87-4f34-a424-bd81c5e65312 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:34.369466 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-415dd0a5-6c87-4f34-a424-bd81c5e65312 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:34.370364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-415dd0a5-6c87-4f34-a424-bd81c5e65312 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:34.370700 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-415dd0a5-6c87-4f34-a424-bd81c5e65312 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:34.403689 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5d3379d2-5e33-4e6c-b9e2-96b48a5153ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:34.414377 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5d3379d2-5e33-4e6c-b9e2-96b48a5153ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.286129 Aug 13 04:33:34.425962 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 331/678] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:34 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:34.430975 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-8349d5e1-aab5-4198-80b3-e0f4fd43c0c6 req-6c5cfabf-6352-4f6b-b93a-cbd7d383ba6d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da403df1-360d-41cf-86fd-0b09258785d0", "tag": "90912158-5071-4e18-b5b5-6e2227fd5493"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:34.432915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:34.432915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:33:34.441053 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-8349d5e1-aab5-4198-80b3-e0f4fd43c0c6 req-6c5cfabf-6352-4f6b-b93a-cbd7d383ba6d service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:34.441803 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-8349d5e1-aab5-4198-80b3-e0f4fd43c0c6 req-6c5cfabf-6352-4f6b-b93a-cbd7d383ba6d service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:34.459014 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-8349d5e1-aab5-4198-80b3-e0f4fd43c0c6 req-6c5cfabf-6352-4f6b-b93a-cbd7d383ba6d service nova] Creating event network-changed:90912158-5071-4e18-b5b5-6e2227fd5493 for instance da403df1-360d-41cf-86fd-0b09258785d0 on hv-cinder-75996 Aug 13 04:33:34.464348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-8349d5e1-aab5-4198-80b3-e0f4fd43c0c6 req-6c5cfabf-6352-4f6b-b93a-cbd7d383ba6d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036810 Aug 13 04:33:34.464965 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 332/679] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:34.556544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-415dd0a5-6c87-4f34-a424-bd81c5e65312 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:34.564420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-415dd0a5-6c87-4f34-a424-bd81c5e65312 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.206906 Aug 13 04:33:34.565624 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 348/680] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:34 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:34.592670 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4d0d054d-6ff5-40ee-88f0-4e4aebc1d472 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:34.593294 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4d0d054d-6ff5-40ee-88f0-4e4aebc1d472 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:34.600243 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d0d054d-6ff5-40ee-88f0-4e4aebc1d472 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:34.601056 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d0d054d-6ff5-40ee-88f0-4e4aebc1d472 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:34.602145 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d0d054d-6ff5-40ee-88f0-4e4aebc1d472 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:34.602823 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d0d054d-6ff5-40ee-88f0-4e4aebc1d472 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:34.748181 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4d0d054d-6ff5-40ee-88f0-4e4aebc1d472 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:34.756550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4d0d054d-6ff5-40ee-88f0-4e4aebc1d472 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.168323 Aug 13 04:33:34.757119 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 333/681] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:34 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:34.866096 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c86dc4be-5994-43c0-9954-e1fdc888faf1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:34.866691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c86dc4be-5994-43c0-9954-e1fdc888faf1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:34.872856 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c86dc4be-5994-43c0-9954-e1fdc888faf1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:34.873311 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c86dc4be-5994-43c0-9954-e1fdc888faf1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:34.874139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c86dc4be-5994-43c0-9954-e1fdc888faf1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:34.874610 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c86dc4be-5994-43c0-9954-e1fdc888faf1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.007159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c86dc4be-5994-43c0-9954-e1fdc888faf1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:35.014626 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c86dc4be-5994-43c0-9954-e1fdc888faf1 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.153194 Aug 13 04:33:35.023511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 349/682] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:34 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:35.143497 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-eb954a81-435c-45fd-9d84-65ff89352338 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:35.144421 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-eb954a81-435c-45fd-9d84-65ff89352338 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:35.150643 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eb954a81-435c-45fd-9d84-65ff89352338 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:35.150988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eb954a81-435c-45fd-9d84-65ff89352338 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.151765 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eb954a81-435c-45fd-9d84-65ff89352338 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:35.152285 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eb954a81-435c-45fd-9d84-65ff89352338 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.281483 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-eb954a81-435c-45fd-9d84-65ff89352338 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:35.290830 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-eb954a81-435c-45fd-9d84-65ff89352338 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:35.292320 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-eb954a81-435c-45fd-9d84-65ff89352338 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:35.293473 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-eb954a81-435c-45fd-9d84-65ff89352338 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.153929 Aug 13 04:33:35.294064 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 334/683] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:35 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:35.305781 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-99c5d743-a132-40c3-9aef-dfc7fc941ca6 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:35.306434 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-99c5d743-a132-40c3-9aef-dfc7fc941ca6 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:35.312362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-99c5d743-a132-40c3-9aef-dfc7fc941ca6 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:35.312819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-99c5d743-a132-40c3-9aef-dfc7fc941ca6 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.313651 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-99c5d743-a132-40c3-9aef-dfc7fc941ca6 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:35.314091 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-99c5d743-a132-40c3-9aef-dfc7fc941ca6 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.432264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-80172a7d-f638-4c23-b254-7485b47ba4d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:35.433884 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-80172a7d-f638-4c23-b254-7485b47ba4d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:35.442058 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-80172a7d-f638-4c23-b254-7485b47ba4d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:35.442890 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-80172a7d-f638-4c23-b254-7485b47ba4d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.443738 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-80172a7d-f638-4c23-b254-7485b47ba4d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:35.444231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-80172a7d-f638-4c23-b254-7485b47ba4d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.447954 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-99c5d743-a132-40c3-9aef-dfc7fc941ca6 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:35.455579 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-99c5d743-a132-40c3-9aef-dfc7fc941ca6 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.154229 Aug 13 04:33:35.456182 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 350/684] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:35 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:35.580721 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-80172a7d-f638-4c23-b254-7485b47ba4d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:35.583714 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-82fdb919-1e8a-47db-acf7-4439e6d21787 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:35.584334 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-82fdb919-1e8a-47db-acf7-4439e6d21787 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:35.589376 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-80172a7d-f638-4c23-b254-7485b47ba4d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.160812 Aug 13 04:33:35.590156 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 335/685] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:35 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:35.598673 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-82fdb919-1e8a-47db-acf7-4439e6d21787 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:35.599131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-82fdb919-1e8a-47db-acf7-4439e6d21787 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.599932 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-82fdb919-1e8a-47db-acf7-4439e6d21787 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:35.600378 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-82fdb919-1e8a-47db-acf7-4439e6d21787 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.743874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-82fdb919-1e8a-47db-acf7-4439e6d21787 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:35.752781 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-82fdb919-1e8a-47db-acf7-4439e6d21787 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.173432 Aug 13 04:33:35.754263 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 351/686] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:35 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:35.773754 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-cdfca31d-824a-4669-af09-edc7e5dca4ac tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:35.774368 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-cdfca31d-824a-4669-af09-edc7e5dca4ac tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:35.780390 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cdfca31d-824a-4669-af09-edc7e5dca4ac tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:35.780838 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cdfca31d-824a-4669-af09-edc7e5dca4ac tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.781642 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cdfca31d-824a-4669-af09-edc7e5dca4ac tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:35.782078 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cdfca31d-824a-4669-af09-edc7e5dca4ac tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:35.911071 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-cdfca31d-824a-4669-af09-edc7e5dca4ac tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:35.919351 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-cdfca31d-824a-4669-af09-edc7e5dca4ac tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.149935 Aug 13 04:33:35.920041 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 336/687] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:35 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:36.031809 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-97430ba4-c6b9-4d86-b817-7344aecdd8b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:36.032338 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-97430ba4-c6b9-4d86-b817-7344aecdd8b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:36.038583 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-97430ba4-c6b9-4d86-b817-7344aecdd8b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.039142 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-97430ba4-c6b9-4d86-b817-7344aecdd8b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.039801 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-97430ba4-c6b9-4d86-b817-7344aecdd8b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.040321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-97430ba4-c6b9-4d86-b817-7344aecdd8b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.186867 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-97430ba4-c6b9-4d86-b817-7344aecdd8b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:36.195317 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-97430ba4-c6b9-4d86-b817-7344aecdd8b2 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.167212 Aug 13 04:33:36.196097 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 352/688] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:36 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:36.311938 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bbc05e18-7b37-41f2-998c-92cf64d6c102 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:36.312500 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bbc05e18-7b37-41f2-998c-92cf64d6c102 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:36.319877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bbc05e18-7b37-41f2-998c-92cf64d6c102 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.320320 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bbc05e18-7b37-41f2-998c-92cf64d6c102 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.321085 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bbc05e18-7b37-41f2-998c-92cf64d6c102 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.321550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bbc05e18-7b37-41f2-998c-92cf64d6c102 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.449443 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bbc05e18-7b37-41f2-998c-92cf64d6c102 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:36.457857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bbc05e18-7b37-41f2-998c-92cf64d6c102 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:36.459354 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bbc05e18-7b37-41f2-998c-92cf64d6c102 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:36.460677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bbc05e18-7b37-41f2-998c-92cf64d6c102 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.152438 Aug 13 04:33:36.461284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 337/689] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:36 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:36.474117 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-33efa183-3b36-4afb-a03b-753ed7195a8a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:36.474837 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-33efa183-3b36-4afb-a03b-753ed7195a8a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:36.481287 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33efa183-3b36-4afb-a03b-753ed7195a8a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.481836 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33efa183-3b36-4afb-a03b-753ed7195a8a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.482708 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33efa183-3b36-4afb-a03b-753ed7195a8a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.483225 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33efa183-3b36-4afb-a03b-753ed7195a8a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.606401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-10f4f4c2-4b91-465e-a623-4f2fc417b84c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:36.607121 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-10f4f4c2-4b91-465e-a623-4f2fc417b84c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:36.615075 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-33efa183-3b36-4afb-a03b-753ed7195a8a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:36.617371 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-10f4f4c2-4b91-465e-a623-4f2fc417b84c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.617934 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-10f4f4c2-4b91-465e-a623-4f2fc417b84c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.618813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-10f4f4c2-4b91-465e-a623-4f2fc417b84c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.619488 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-10f4f4c2-4b91-465e-a623-4f2fc417b84c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.630689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-33efa183-3b36-4afb-a03b-753ed7195a8a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.161220 Aug 13 04:33:36.631522 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 353/690] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:36 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:36.755889 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-10f4f4c2-4b91-465e-a623-4f2fc417b84c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:36.770201 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-10f4f4c2-4b91-465e-a623-4f2fc417b84c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.166421 Aug 13 04:33:36.771244 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 338/691] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:36 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:36.771730 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f4acffcc-137a-49fc-826c-96d155014b02 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:36.772365 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f4acffcc-137a-49fc-826c-96d155014b02 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:36.782607 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f4acffcc-137a-49fc-826c-96d155014b02 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.783060 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f4acffcc-137a-49fc-826c-96d155014b02 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.783841 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f4acffcc-137a-49fc-826c-96d155014b02 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.784276 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f4acffcc-137a-49fc-826c-96d155014b02 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.915828 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f4acffcc-137a-49fc-826c-96d155014b02 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:36.923073 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f4acffcc-137a-49fc-826c-96d155014b02 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.156120 Aug 13 04:33:36.923664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 354/692] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:36 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:36.936529 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4378da38-97f4-4b42-939d-072f3a8f33a6 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:36.937159 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4378da38-97f4-4b42-939d-072f3a8f33a6 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:36.943510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4378da38-97f4-4b42-939d-072f3a8f33a6 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.943957 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4378da38-97f4-4b42-939d-072f3a8f33a6 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:36.944733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4378da38-97f4-4b42-939d-072f3a8f33a6 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:36.945171 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4378da38-97f4-4b42-939d-072f3a8f33a6 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:37.080555 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4378da38-97f4-4b42-939d-072f3a8f33a6 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:37.089677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4378da38-97f4-4b42-939d-072f3a8f33a6 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.156240 Aug 13 04:33:37.089677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 339/693] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:36 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:37.212529 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-68b14e5b-f240-4db6-b48e-5907458e0391 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:37.213080 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-68b14e5b-f240-4db6-b48e-5907458e0391 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:37.218870 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68b14e5b-f240-4db6-b48e-5907458e0391 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:37.219317 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68b14e5b-f240-4db6-b48e-5907458e0391 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:37.220096 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68b14e5b-f240-4db6-b48e-5907458e0391 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:37.220537 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68b14e5b-f240-4db6-b48e-5907458e0391 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:37.353084 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-68b14e5b-f240-4db6-b48e-5907458e0391 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:37.360757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-68b14e5b-f240-4db6-b48e-5907458e0391 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.151947 Aug 13 04:33:37.361495 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 355/694] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:37 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:37.479585 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b6a35be4-97aa-436c-aa80-d55a9832bfb1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:37.480155 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b6a35be4-97aa-436c-aa80-d55a9832bfb1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:37.486182 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b6a35be4-97aa-436c-aa80-d55a9832bfb1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:37.486630 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b6a35be4-97aa-436c-aa80-d55a9832bfb1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:37.489414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b6a35be4-97aa-436c-aa80-d55a9832bfb1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:37.489414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b6a35be4-97aa-436c-aa80-d55a9832bfb1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:37.617186 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b6a35be4-97aa-436c-aa80-d55a9832bfb1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:37.625964 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b6a35be4-97aa-436c-aa80-d55a9832bfb1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:37.627451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b6a35be4-97aa-436c-aa80-d55a9832bfb1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:37.629188 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b6a35be4-97aa-436c-aa80-d55a9832bfb1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.152930 Aug 13 04:33:37.636012 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 340/695] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:37 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:37.648630 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-198a0a49-96db-436f-a305-9f7b0cf983ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:37.649242 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-198a0a49-96db-436f-a305-9f7b0cf983ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:37.655398 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-198a0a49-96db-436f-a305-9f7b0cf983ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:37.655847 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-198a0a49-96db-436f-a305-9f7b0cf983ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:37.656623 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-198a0a49-96db-436f-a305-9f7b0cf983ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:37.657061 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-198a0a49-96db-436f-a305-9f7b0cf983ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:37.787126 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5736f4af-ae45-4f54-ab75-63dd8d56fca9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:37.787731 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5736f4af-ae45-4f54-ab75-63dd8d56fca9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:37.787845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-198a0a49-96db-436f-a305-9f7b0cf983ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:37.793595 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5736f4af-ae45-4f54-ab75-63dd8d56fca9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:37.794055 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5736f4af-ae45-4f54-ab75-63dd8d56fca9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:37.794831 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5736f4af-ae45-4f54-ab75-63dd8d56fca9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:37.795038 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-198a0a49-96db-436f-a305-9f7b0cf983ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.150651 Aug 13 04:33:37.795257 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5736f4af-ae45-4f54-ab75-63dd8d56fca9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:37.795609 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 356/696] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:37 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:37.925805 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5736f4af-ae45-4f54-ab75-63dd8d56fca9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:37.933825 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5736f4af-ae45-4f54-ab75-63dd8d56fca9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.150332 Aug 13 04:33:37.934616 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 341/697] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:37 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:37.940531 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4d7151ee-f3e6-44da-b23d-aae38df0a856 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:37.942352 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4d7151ee-f3e6-44da-b23d-aae38df0a856 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:37.948697 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4d7151ee-f3e6-44da-b23d-aae38df0a856 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:37.949152 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4d7151ee-f3e6-44da-b23d-aae38df0a856 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:37.949969 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4d7151ee-f3e6-44da-b23d-aae38df0a856 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:37.950406 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4d7151ee-f3e6-44da-b23d-aae38df0a856 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.081258 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4d7151ee-f3e6-44da-b23d-aae38df0a856 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:38.088806 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4d7151ee-f3e6-44da-b23d-aae38df0a856 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.152346 Aug 13 04:33:38.089373 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 357/698] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:37 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:38.105503 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e064c5e2-1649-42ed-9406-d98ce931c3ed tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:38.106171 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e064c5e2-1649-42ed-9406-d98ce931c3ed tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:38.114544 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e064c5e2-1649-42ed-9406-d98ce931c3ed tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:38.114998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e064c5e2-1649-42ed-9406-d98ce931c3ed tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.115788 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e064c5e2-1649-42ed-9406-d98ce931c3ed tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:38.116283 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e064c5e2-1649-42ed-9406-d98ce931c3ed tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.250900 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e064c5e2-1649-42ed-9406-d98ce931c3ed tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:38.258806 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e064c5e2-1649-42ed-9406-d98ce931c3ed tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.156960 Aug 13 04:33:38.259448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 342/699] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:38 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:38.377797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-fbe4f907-4924-4160-8905-a7fd44940ac5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:38.378450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-fbe4f907-4924-4160-8905-a7fd44940ac5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:38.384553 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fbe4f907-4924-4160-8905-a7fd44940ac5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:38.385005 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fbe4f907-4924-4160-8905-a7fd44940ac5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.385828 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fbe4f907-4924-4160-8905-a7fd44940ac5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:38.386297 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fbe4f907-4924-4160-8905-a7fd44940ac5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.513339 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-fbe4f907-4924-4160-8905-a7fd44940ac5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:38.522375 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-fbe4f907-4924-4160-8905-a7fd44940ac5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.148238 Aug 13 04:33:38.522967 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 358/700] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:38 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:38.649726 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9880fed5-a158-448c-9fbf-37ca1f7a0caa tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:38.650359 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9880fed5-a158-448c-9fbf-37ca1f7a0caa tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:38.656933 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9880fed5-a158-448c-9fbf-37ca1f7a0caa tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:38.657594 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9880fed5-a158-448c-9fbf-37ca1f7a0caa tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.658377 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9880fed5-a158-448c-9fbf-37ca1f7a0caa tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:38.658818 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9880fed5-a158-448c-9fbf-37ca1f7a0caa tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.797063 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9880fed5-a158-448c-9fbf-37ca1f7a0caa tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:38.806938 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9880fed5-a158-448c-9fbf-37ca1f7a0caa tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:38.808652 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9880fed5-a158-448c-9fbf-37ca1f7a0caa tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:38.809840 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9880fed5-a158-448c-9fbf-37ca1f7a0caa tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.165658 Aug 13 04:33:38.810681 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 343/701] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:38 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:38.814139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5c2adaf7-0cc9-4b05-af67-65e437a8c1c3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:38.815035 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5c2adaf7-0cc9-4b05-af67-65e437a8c1c3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:38.821178 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5c2adaf7-0cc9-4b05-af67-65e437a8c1c3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:38.821683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5c2adaf7-0cc9-4b05-af67-65e437a8c1c3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.822450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5c2adaf7-0cc9-4b05-af67-65e437a8c1c3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:38.822876 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5c2adaf7-0cc9-4b05-af67-65e437a8c1c3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.954265 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4ec8160f-12f6-418e-b3a9-f39db5362efd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:38.954990 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4ec8160f-12f6-418e-b3a9-f39db5362efd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:38.960139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5c2adaf7-0cc9-4b05-af67-65e437a8c1c3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:38.968006 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4ec8160f-12f6-418e-b3a9-f39db5362efd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:38.968462 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4ec8160f-12f6-418e-b3a9-f39db5362efd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.969399 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4ec8160f-12f6-418e-b3a9-f39db5362efd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:38.969983 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4ec8160f-12f6-418e-b3a9-f39db5362efd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:38.971220 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5c2adaf7-0cc9-4b05-af67-65e437a8c1c3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.161359 Aug 13 04:33:38.971809 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 359/702] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:38 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:39.106260 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a1999f93-39ab-40be-a5a8-ba0189b53eb8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:39.107540 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a1999f93-39ab-40be-a5a8-ba0189b53eb8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:39.109461 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4ec8160f-12f6-418e-b3a9-f39db5362efd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:39.115868 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a1999f93-39ab-40be-a5a8-ba0189b53eb8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:39.116585 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a1999f93-39ab-40be-a5a8-ba0189b53eb8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:39.117571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a1999f93-39ab-40be-a5a8-ba0189b53eb8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:39.118012 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a1999f93-39ab-40be-a5a8-ba0189b53eb8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:39.118430 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4ec8160f-12f6-418e-b3a9-f39db5362efd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.169144 Aug 13 04:33:39.119015 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 344/703] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:38 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:39.246754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a1999f93-39ab-40be-a5a8-ba0189b53eb8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:39.255310 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a1999f93-39ab-40be-a5a8-ba0189b53eb8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.152807 Aug 13 04:33:39.255894 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 360/704] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:39 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:39.276096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-02465c3f-861f-4a96-8c28-0e6bb6fcc8c0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:39.276714 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-02465c3f-861f-4a96-8c28-0e6bb6fcc8c0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:39.283039 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-02465c3f-861f-4a96-8c28-0e6bb6fcc8c0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:39.283491 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-02465c3f-861f-4a96-8c28-0e6bb6fcc8c0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:39.284454 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-02465c3f-861f-4a96-8c28-0e6bb6fcc8c0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:39.285083 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-02465c3f-861f-4a96-8c28-0e6bb6fcc8c0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:39.413001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-02465c3f-861f-4a96-8c28-0e6bb6fcc8c0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:39.420513 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-02465c3f-861f-4a96-8c28-0e6bb6fcc8c0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.148879 Aug 13 04:33:39.421085 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 345/705] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:39 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:39.540059 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f27e6b07-ac02-46a5-b25a-658adc91422d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:39.540605 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f27e6b07-ac02-46a5-b25a-658adc91422d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:39.546641 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f27e6b07-ac02-46a5-b25a-658adc91422d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:39.547090 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f27e6b07-ac02-46a5-b25a-658adc91422d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:39.547856 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f27e6b07-ac02-46a5-b25a-658adc91422d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:39.548346 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f27e6b07-ac02-46a5-b25a-658adc91422d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:39.675732 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f27e6b07-ac02-46a5-b25a-658adc91422d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:39.683127 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f27e6b07-ac02-46a5-b25a-658adc91422d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.146830 Aug 13 04:33:39.683791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 361/706] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:39 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:39.828550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f0b82603-99a7-451d-a03d-797efef245cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:39.829226 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f0b82603-99a7-451d-a03d-797efef245cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:39.835885 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f0b82603-99a7-451d-a03d-797efef245cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:39.836336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f0b82603-99a7-451d-a03d-797efef245cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:39.837122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f0b82603-99a7-451d-a03d-797efef245cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:39.837590 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f0b82603-99a7-451d-a03d-797efef245cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:39.963639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f0b82603-99a7-451d-a03d-797efef245cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:39.971923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f0b82603-99a7-451d-a03d-797efef245cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:39.973753 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f0b82603-99a7-451d-a03d-797efef245cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:39.974901 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f0b82603-99a7-451d-a03d-797efef245cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.150413 Aug 13 04:33:39.975458 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 346/707] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:39 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:39.988917 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-88fcbe08-4515-4a0b-a035-bf1c48922297 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:39.989564 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-88fcbe08-4515-4a0b-a035-bf1c48922297 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:39.996072 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88fcbe08-4515-4a0b-a035-bf1c48922297 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:39.996464 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88fcbe08-4515-4a0b-a035-bf1c48922297 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:39.997235 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88fcbe08-4515-4a0b-a035-bf1c48922297 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:39.997694 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88fcbe08-4515-4a0b-a035-bf1c48922297 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:40.129821 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-88fcbe08-4515-4a0b-a035-bf1c48922297 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:40.135087 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e5c3771d-68cc-4df0-9b2d-b3a3f9e35477 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:40.135706 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e5c3771d-68cc-4df0-9b2d-b3a3f9e35477 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:40.137802 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-88fcbe08-4515-4a0b-a035-bf1c48922297 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.153352 Aug 13 04:33:40.138476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 362/708] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:39 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:40.145955 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5c3771d-68cc-4df0-9b2d-b3a3f9e35477 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:40.146397 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5c3771d-68cc-4df0-9b2d-b3a3f9e35477 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:40.147573 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5c3771d-68cc-4df0-9b2d-b3a3f9e35477 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:40.148326 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5c3771d-68cc-4df0-9b2d-b3a3f9e35477 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:40.272090 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8dac9c9e-dbc4-4014-aa0d-2519ec5c8d84 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:40.272713 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8dac9c9e-dbc4-4014-aa0d-2519ec5c8d84 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:40.279152 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8dac9c9e-dbc4-4014-aa0d-2519ec5c8d84 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:40.279152 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8dac9c9e-dbc4-4014-aa0d-2519ec5c8d84 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:40.279805 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8dac9c9e-dbc4-4014-aa0d-2519ec5c8d84 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:40.280209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8dac9c9e-dbc4-4014-aa0d-2519ec5c8d84 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:40.288869 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e5c3771d-68cc-4df0-9b2d-b3a3f9e35477 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:40.298655 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e5c3771d-68cc-4df0-9b2d-b3a3f9e35477 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.167087 Aug 13 04:33:40.300021 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 347/709] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:40 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:40.406365 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8dac9c9e-dbc4-4014-aa0d-2519ec5c8d84 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:40.415247 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8dac9c9e-dbc4-4014-aa0d-2519ec5c8d84 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.146930 Aug 13 04:33:40.415827 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 363/710] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:40 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:40.438372 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a59da48b-4125-4af9-b3b4-2138b57d8776 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:40.438982 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a59da48b-4125-4af9-b3b4-2138b57d8776 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:40.446618 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a59da48b-4125-4af9-b3b4-2138b57d8776 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:40.447059 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a59da48b-4125-4af9-b3b4-2138b57d8776 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:40.447828 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a59da48b-4125-4af9-b3b4-2138b57d8776 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:40.448252 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a59da48b-4125-4af9-b3b4-2138b57d8776 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:40.573323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a59da48b-4125-4af9-b3b4-2138b57d8776 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:40.580860 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a59da48b-4125-4af9-b3b4-2138b57d8776 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.146592 Aug 13 04:33:40.582188 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 348/711] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:40 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:40.700680 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-16da5ddc-c61f-426b-bf8b-5b951dc826f5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:40.701289 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-16da5ddc-c61f-426b-bf8b-5b951dc826f5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:40.707912 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-16da5ddc-c61f-426b-bf8b-5b951dc826f5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:40.708370 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-16da5ddc-c61f-426b-bf8b-5b951dc826f5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:40.709165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-16da5ddc-c61f-426b-bf8b-5b951dc826f5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:40.709664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-16da5ddc-c61f-426b-bf8b-5b951dc826f5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:40.857026 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-16da5ddc-c61f-426b-bf8b-5b951dc826f5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:40.864760 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-16da5ddc-c61f-426b-bf8b-5b951dc826f5 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.168106 Aug 13 04:33:40.865334 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 364/712] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:40 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:40.992134 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4b988408-92d3-4b04-8d0b-ef30cb3e0ed0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:40.992746 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4b988408-92d3-4b04-8d0b-ef30cb3e0ed0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:40.999122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4b988408-92d3-4b04-8d0b-ef30cb3e0ed0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:40.999569 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4b988408-92d3-4b04-8d0b-ef30cb3e0ed0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.000352 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4b988408-92d3-4b04-8d0b-ef30cb3e0ed0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.000787 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4b988408-92d3-4b04-8d0b-ef30cb3e0ed0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.127509 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4b988408-92d3-4b04-8d0b-ef30cb3e0ed0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:41.136319 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4b988408-92d3-4b04-8d0b-ef30cb3e0ed0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:41.137832 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4b988408-92d3-4b04-8d0b-ef30cb3e0ed0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:41.138966 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4b988408-92d3-4b04-8d0b-ef30cb3e0ed0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.150624 Aug 13 04:33:41.139525 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 349/713] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:40 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:41.154943 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1e129097-5c37-4c8e-8cea-5e0a2380ff1e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:41.155813 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1e129097-5c37-4c8e-8cea-5e0a2380ff1e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:41.161962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1e129097-5c37-4c8e-8cea-5e0a2380ff1e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.162490 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1e129097-5c37-4c8e-8cea-5e0a2380ff1e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.163302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1e129097-5c37-4c8e-8cea-5e0a2380ff1e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.163735 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1e129097-5c37-4c8e-8cea-5e0a2380ff1e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.295529 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1e129097-5c37-4c8e-8cea-5e0a2380ff1e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:41.304731 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1e129097-5c37-4c8e-8cea-5e0a2380ff1e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.153593 Aug 13 04:33:41.308368 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 365/714] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:41 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:41.316657 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bb1a2842-ac89-4f7d-a971-c5c3259b3569 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:41.317266 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bb1a2842-ac89-4f7d-a971-c5c3259b3569 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:41.326040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bb1a2842-ac89-4f7d-a971-c5c3259b3569 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.326493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bb1a2842-ac89-4f7d-a971-c5c3259b3569 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.327283 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bb1a2842-ac89-4f7d-a971-c5c3259b3569 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.327721 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bb1a2842-ac89-4f7d-a971-c5c3259b3569 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.433832 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-bed019da-9bf4-4c5d-9609-383a33bd8303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:41.434442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-bed019da-9bf4-4c5d-9609-383a33bd8303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:41.441327 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bed019da-9bf4-4c5d-9609-383a33bd8303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.441762 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bed019da-9bf4-4c5d-9609-383a33bd8303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.442569 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bed019da-9bf4-4c5d-9609-383a33bd8303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.442986 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bed019da-9bf4-4c5d-9609-383a33bd8303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.465034 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bb1a2842-ac89-4f7d-a971-c5c3259b3569 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:41.481672 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bb1a2842-ac89-4f7d-a971-c5c3259b3569 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.169085 Aug 13 04:33:41.482380 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 350/715] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:41 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:41.584940 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-bed019da-9bf4-4c5d-9609-383a33bd8303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:41.593507 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-bed019da-9bf4-4c5d-9609-383a33bd8303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.163526 Aug 13 04:33:41.594448 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 366/716] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:41 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:41.600286 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7d591e34-250e-45e6-8eaa-b4b6526b8261 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:41.600891 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7d591e34-250e-45e6-8eaa-b4b6526b8261 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:41.609326 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7d591e34-250e-45e6-8eaa-b4b6526b8261 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.609834 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7d591e34-250e-45e6-8eaa-b4b6526b8261 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.610634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7d591e34-250e-45e6-8eaa-b4b6526b8261 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.611046 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7d591e34-250e-45e6-8eaa-b4b6526b8261 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.751319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2a0cab3c-f90d-405f-92a2-cbd03f8d218f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:41.751907 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2a0cab3c-f90d-405f-92a2-cbd03f8d218f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:41.752254 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7d591e34-250e-45e6-8eaa-b4b6526b8261 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:41.761703 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7d591e34-250e-45e6-8eaa-b4b6526b8261 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.165509 Aug 13 04:33:41.762482 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 351/717] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:41 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:41.763207 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2a0cab3c-f90d-405f-92a2-cbd03f8d218f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.763661 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2a0cab3c-f90d-405f-92a2-cbd03f8d218f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.764447 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2a0cab3c-f90d-405f-92a2-cbd03f8d218f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.764878 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2a0cab3c-f90d-405f-92a2-cbd03f8d218f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.872843 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-2a0cab3c-f90d-405f-92a2-cbd03f8d218f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lazy-loading 'services' on Instance uuid a0662f42-e77d-4f85-84ad-b58befdc445d {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:33:41.882697 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a5a91b3a-7b0e-4c14-b069-7379915d4cb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:41.883411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a5a91b3a-7b0e-4c14-b069-7379915d4cb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:41.890227 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a5a91b3a-7b0e-4c14-b069-7379915d4cb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.890690 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a5a91b3a-7b0e-4c14-b069-7379915d4cb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.891476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a5a91b3a-7b0e-4c14-b069-7379915d4cb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:41.892142 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a5a91b3a-7b0e-4c14-b069-7379915d4cb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:41.959959 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2a0cab3c-f90d-405f-92a2-cbd03f8d218f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/os-volume_attachments/4dd9d1fb-386c-41c8-aea5-a5488efa68f5" status: 202 len: 0 microversion: 2.1 time: 0.212223 Aug 13 04:33:41.960603 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 367/718] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:33:41 2021] DELETE /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/os-volume_attachments/4dd9d1fb-386c-41c8-aea5-a5488efa68f5 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:33:42.160862 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-45dabec7-6bc2-4605-83c9-c65375e91f8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:42.162023 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-45dabec7-6bc2-4605-83c9-c65375e91f8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:42.171160 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-45dabec7-6bc2-4605-83c9-c65375e91f8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:42.172057 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-45dabec7-6bc2-4605-83c9-c65375e91f8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:42.172863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-45dabec7-6bc2-4605-83c9-c65375e91f8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:42.173304 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-45dabec7-6bc2-4605-83c9-c65375e91f8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:42.328857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a5a91b3a-7b0e-4c14-b069-7379915d4cb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:42.337171 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a5a91b3a-7b0e-4c14-b069-7379915d4cb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.458833 Aug 13 04:33:42.338059 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 352/719] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:41 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:42.343317 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b07220bf-f8c6-4ada-bba6-20f60b3ec5e4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:42.344156 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b07220bf-f8c6-4ada-bba6-20f60b3ec5e4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:42.353798 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b07220bf-f8c6-4ada-bba6-20f60b3ec5e4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:42.354466 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b07220bf-f8c6-4ada-bba6-20f60b3ec5e4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:42.355259 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b07220bf-f8c6-4ada-bba6-20f60b3ec5e4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:42.355691 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b07220bf-f8c6-4ada-bba6-20f60b3ec5e4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:42.408630 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-45dabec7-6bc2-4605-83c9-c65375e91f8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:42.424511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-45dabec7-6bc2-4605-83c9-c65375e91f8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:42.426202 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-45dabec7-6bc2-4605-83c9-c65375e91f8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:42.427597 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-45dabec7-6bc2-4605-83c9-c65375e91f8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.271031 Aug 13 04:33:42.428164 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 368/720] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:42 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:42.490503 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b07220bf-f8c6-4ada-bba6-20f60b3ec5e4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:42.498615 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b07220bf-f8c6-4ada-bba6-20f60b3ec5e4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.159386 Aug 13 04:33:42.498849 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-75faf93a-8df7-4675-b1ba-a1d1dfcc0e11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:42.499194 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 353/721] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:42 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:42.499469 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-75faf93a-8df7-4675-b1ba-a1d1dfcc0e11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:42.505802 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-75faf93a-8df7-4675-b1ba-a1d1dfcc0e11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:42.506256 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-75faf93a-8df7-4675-b1ba-a1d1dfcc0e11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:42.507029 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-75faf93a-8df7-4675-b1ba-a1d1dfcc0e11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:42.507467 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-75faf93a-8df7-4675-b1ba-a1d1dfcc0e11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:42.611000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-659f9f72-fb09-4aa2-ae8a-3b2819d7d533 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:42.611719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-659f9f72-fb09-4aa2-ae8a-3b2819d7d533 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:42.618353 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-659f9f72-fb09-4aa2-ae8a-3b2819d7d533 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:42.618811 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-659f9f72-fb09-4aa2-ae8a-3b2819d7d533 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:42.619601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-659f9f72-fb09-4aa2-ae8a-3b2819d7d533 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:42.620618 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-659f9f72-fb09-4aa2-ae8a-3b2819d7d533 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:42.647224 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-75faf93a-8df7-4675-b1ba-a1d1dfcc0e11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:42.658980 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-75faf93a-8df7-4675-b1ba-a1d1dfcc0e11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.163834 Aug 13 04:33:42.660026 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 369/722] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:42 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:42.781560 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-290c3ed6-e8fd-4af9-865b-316160c9cd69 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:42.782183 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-290c3ed6-e8fd-4af9-865b-316160c9cd69 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:42.784116 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-659f9f72-fb09-4aa2-ae8a-3b2819d7d533 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:42.790165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-290c3ed6-e8fd-4af9-865b-316160c9cd69 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:42.790861 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-290c3ed6-e8fd-4af9-865b-316160c9cd69 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:42.792286 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-290c3ed6-e8fd-4af9-865b-316160c9cd69 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:42.792820 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-659f9f72-fb09-4aa2-ae8a-3b2819d7d533 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.185691 Aug 13 04:33:42.793239 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-290c3ed6-e8fd-4af9-865b-316160c9cd69 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:42.796063 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 354/723] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:42 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:42.938209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-290c3ed6-e8fd-4af9-865b-316160c9cd69 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:42.946908 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-290c3ed6-e8fd-4af9-865b-316160c9cd69 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.169323 Aug 13 04:33:42.949644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 370/724] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:42 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:43.355874 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0deba071-54e8-46d4-ab2f-37bdfe56d7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:43.356688 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0deba071-54e8-46d4-ab2f-37bdfe56d7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:43.363096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0deba071-54e8-46d4-ab2f-37bdfe56d7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.363541 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0deba071-54e8-46d4-ab2f-37bdfe56d7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.364377 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0deba071-54e8-46d4-ab2f-37bdfe56d7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.364815 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0deba071-54e8-46d4-ab2f-37bdfe56d7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.447686 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7a74a8d4-696e-4ecf-8a1a-d15413b159f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:43.448325 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7a74a8d4-696e-4ecf-8a1a-d15413b159f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:43.455362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a74a8d4-696e-4ecf-8a1a-d15413b159f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.455865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a74a8d4-696e-4ecf-8a1a-d15413b159f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.458009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a74a8d4-696e-4ecf-8a1a-d15413b159f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.458422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a74a8d4-696e-4ecf-8a1a-d15413b159f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.498812 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-0deba071-54e8-46d4-ab2f-37bdfe56d7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:43.510532 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0deba071-54e8-46d4-ab2f-37bdfe56d7c4 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.158798 Aug 13 04:33:43.517782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 355/725] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:43 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:43.524586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c3828683-8c2f-4154-a111-cd490448f64b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:43.525153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c3828683-8c2f-4154-a111-cd490448f64b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:43.531937 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3828683-8c2f-4154-a111-cd490448f64b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.532533 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3828683-8c2f-4154-a111-cd490448f64b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.533411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3828683-8c2f-4154-a111-cd490448f64b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.533961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c3828683-8c2f-4154-a111-cd490448f64b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.627662 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7a74a8d4-696e-4ecf-8a1a-d15413b159f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:43.637243 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7a74a8d4-696e-4ecf-8a1a-d15413b159f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:43.638815 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7a74a8d4-696e-4ecf-8a1a-d15413b159f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:43.639971 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7a74a8d4-696e-4ecf-8a1a-d15413b159f5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.196075 Aug 13 04:33:43.640539 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 371/726] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:43 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:43.676558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0915feca-d1ea-4090-91b8-995806d41259 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:43.677176 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0915feca-d1ea-4090-91b8-995806d41259 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:43.682994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0915feca-d1ea-4090-91b8-995806d41259 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.683451 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0915feca-d1ea-4090-91b8-995806d41259 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.684246 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0915feca-d1ea-4090-91b8-995806d41259 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.684677 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0915feca-d1ea-4090-91b8-995806d41259 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.688155 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c3828683-8c2f-4154-a111-cd490448f64b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:43.697923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c3828683-8c2f-4154-a111-cd490448f64b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.178781 Aug 13 04:33:43.698763 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 356/727] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:43 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:43.811193 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a985c19c-40c7-4dfa-b530-49ee60f8287d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:43.811895 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a985c19c-40c7-4dfa-b530-49ee60f8287d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:43.818108 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0915feca-d1ea-4090-91b8-995806d41259 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:43.820700 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a985c19c-40c7-4dfa-b530-49ee60f8287d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.821463 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a985c19c-40c7-4dfa-b530-49ee60f8287d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.822105 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a985c19c-40c7-4dfa-b530-49ee60f8287d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.822605 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a985c19c-40c7-4dfa-b530-49ee60f8287d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.826388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0915feca-d1ea-4090-91b8-995806d41259 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.154126 Aug 13 04:33:43.831585 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 372/728] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:43 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:43.959278 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a985c19c-40c7-4dfa-b530-49ee60f8287d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:43.963668 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6d8c9ba1-90a9-456b-a53b-02b03802fa93 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:43.964489 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6d8c9ba1-90a9-456b-a53b-02b03802fa93 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:43.969699 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a985c19c-40c7-4dfa-b530-49ee60f8287d tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.162296 Aug 13 04:33:43.970458 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 357/729] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:43 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:43.970969 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6d8c9ba1-90a9-456b-a53b-02b03802fa93 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.971623 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6d8c9ba1-90a9-456b-a53b-02b03802fa93 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:43.972530 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6d8c9ba1-90a9-456b-a53b-02b03802fa93 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:43.973032 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6d8c9ba1-90a9-456b-a53b-02b03802fa93 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:44.110491 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6d8c9ba1-90a9-456b-a53b-02b03802fa93 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:44.118777 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6d8c9ba1-90a9-456b-a53b-02b03802fa93 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.159285 Aug 13 04:33:44.126188 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 373/730] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:43 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:44.528437 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b2981c4d-57aa-4d0e-8b91-12b1c33639ea tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:44.529137 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b2981c4d-57aa-4d0e-8b91-12b1c33639ea tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:44.535443 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b2981c4d-57aa-4d0e-8b91-12b1c33639ea tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:44.535889 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b2981c4d-57aa-4d0e-8b91-12b1c33639ea tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:44.536665 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b2981c4d-57aa-4d0e-8b91-12b1c33639ea tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:44.537090 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b2981c4d-57aa-4d0e-8b91-12b1c33639ea tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:44.658972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-435e5a48-3868-4979-9ff0-d90d1cd79f42 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:44.660525 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-435e5a48-3868-4979-9ff0-d90d1cd79f42 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:44.666478 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-435e5a48-3868-4979-9ff0-d90d1cd79f42 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:44.666929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-435e5a48-3868-4979-9ff0-d90d1cd79f42 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:44.667714 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-435e5a48-3868-4979-9ff0-d90d1cd79f42 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:44.668458 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-435e5a48-3868-4979-9ff0-d90d1cd79f42 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:44.670873 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b2981c4d-57aa-4d0e-8b91-12b1c33639ea tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:44.680821 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b2981c4d-57aa-4d0e-8b91-12b1c33639ea tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.156363 Aug 13 04:33:44.681412 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 358/731] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:44 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:44.715357 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5563f14f-efd8-4466-93b6-2f1766b8db37 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:44.717460 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5563f14f-efd8-4466-93b6-2f1766b8db37 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:44.723005 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5563f14f-efd8-4466-93b6-2f1766b8db37 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:44.723578 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5563f14f-efd8-4466-93b6-2f1766b8db37 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:44.724477 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5563f14f-efd8-4466-93b6-2f1766b8db37 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:44.725003 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5563f14f-efd8-4466-93b6-2f1766b8db37 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:44.832623 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-435e5a48-3868-4979-9ff0-d90d1cd79f42 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:44.842280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-435e5a48-3868-4979-9ff0-d90d1cd79f42 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:44.843783 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-435e5a48-3868-4979-9ff0-d90d1cd79f42 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:44.844942 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-435e5a48-3868-4979-9ff0-d90d1cd79f42 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.189688 Aug 13 04:33:44.845511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 374/732] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:44 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:33:44.854361 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a6c0471d-4170-450e-b027-8ccceb1a324c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:44.855088 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a6c0471d-4170-450e-b027-8ccceb1a324c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:44.861519 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a6c0471d-4170-450e-b027-8ccceb1a324c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:44.861977 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a6c0471d-4170-450e-b027-8ccceb1a324c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:44.863079 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a6c0471d-4170-450e-b027-8ccceb1a324c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:44.863527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a6c0471d-4170-450e-b027-8ccceb1a324c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:44.899238 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5563f14f-efd8-4466-93b6-2f1766b8db37 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:44.908102 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5563f14f-efd8-4466-93b6-2f1766b8db37 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.196286 Aug 13 04:33:44.908887 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 359/733] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:44 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:44.987639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fc2b531a-e01d-457a-b975-e80e0f80d366 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:44.988258 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fc2b531a-e01d-457a-b975-e80e0f80d366 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:44.994630 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fc2b531a-e01d-457a-b975-e80e0f80d366 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:44.994874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a6c0471d-4170-450e-b027-8ccceb1a324c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:44.995063 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fc2b531a-e01d-457a-b975-e80e0f80d366 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:44.995862 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fc2b531a-e01d-457a-b975-e80e0f80d366 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:44.996299 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fc2b531a-e01d-457a-b975-e80e0f80d366 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:45.006599 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a6c0471d-4170-450e-b027-8ccceb1a324c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.159812 Aug 13 04:33:45.007201 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 375/734] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:44 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:45.122870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-fc2b531a-e01d-457a-b975-e80e0f80d366 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:45.131622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fc2b531a-e01d-457a-b975-e80e0f80d366 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.147671 Aug 13 04:33:45.132191 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 360/735] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:44 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:45.143853 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-34400859-e69c-4885-b51b-4c59b76cf5a4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:45.144525 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-34400859-e69c-4885-b51b-4c59b76cf5a4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:45.150418 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34400859-e69c-4885-b51b-4c59b76cf5a4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:45.150864 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34400859-e69c-4885-b51b-4c59b76cf5a4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:45.151643 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34400859-e69c-4885-b51b-4c59b76cf5a4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:45.152080 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-34400859-e69c-4885-b51b-4c59b76cf5a4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:45.298566 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-34400859-e69c-4885-b51b-4c59b76cf5a4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:45.309232 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-34400859-e69c-4885-b51b-4c59b76cf5a4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.169053 Aug 13 04:33:45.309896 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 376/736] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:45 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:45.699289 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2e584f0c-a3f0-4711-8783-6b3715e2dca8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:45.699904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2e584f0c-a3f0-4711-8783-6b3715e2dca8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:45.705939 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e584f0c-a3f0-4711-8783-6b3715e2dca8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:45.706990 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e584f0c-a3f0-4711-8783-6b3715e2dca8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:45.707773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e584f0c-a3f0-4711-8783-6b3715e2dca8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:45.708210 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e584f0c-a3f0-4711-8783-6b3715e2dca8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:45.843685 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2e584f0c-a3f0-4711-8783-6b3715e2dca8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:45.851071 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2e584f0c-a3f0-4711-8783-6b3715e2dca8 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.155481 Aug 13 04:33:45.851627 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 361/737] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:45 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:45.863661 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0017e396-5415-41ec-8980-ce3b56a1fb26 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:45.864283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0017e396-5415-41ec-8980-ce3b56a1fb26 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:45.875411 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0017e396-5415-41ec-8980-ce3b56a1fb26 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:45.875863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0017e396-5415-41ec-8980-ce3b56a1fb26 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:45.876652 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0017e396-5415-41ec-8980-ce3b56a1fb26 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:45.877137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0017e396-5415-41ec-8980-ce3b56a1fb26 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:45.926307 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a6d319d3-5d8f-445f-848d-376865169e56 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:45.926920 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a6d319d3-5d8f-445f-848d-376865169e56 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:45.933010 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6d319d3-5d8f-445f-848d-376865169e56 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:45.933476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6d319d3-5d8f-445f-848d-376865169e56 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:45.934251 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6d319d3-5d8f-445f-848d-376865169e56 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:45.934721 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6d319d3-5d8f-445f-848d-376865169e56 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:46.031356 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0017e396-5415-41ec-8980-ce3b56a1fb26 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:46.039789 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0017e396-5415-41ec-8980-ce3b56a1fb26 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:46.041339 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0017e396-5415-41ec-8980-ce3b56a1fb26 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:46.042482 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0017e396-5415-41ec-8980-ce3b56a1fb26 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.183355 Aug 13 04:33:46.043042 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 377/738] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:45 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:46.047329 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-47e17123-25e1-4468-8ffc-9ded5e1f56d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:46.047941 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-47e17123-25e1-4468-8ffc-9ded5e1f56d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:46.054856 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-47e17123-25e1-4468-8ffc-9ded5e1f56d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:46.055322 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-47e17123-25e1-4468-8ffc-9ded5e1f56d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:46.056098 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-47e17123-25e1-4468-8ffc-9ded5e1f56d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:46.056536 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-47e17123-25e1-4468-8ffc-9ded5e1f56d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:46.088105 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a6d319d3-5d8f-445f-848d-376865169e56 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:46.095444 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a6d319d3-5d8f-445f-848d-376865169e56 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.173605 Aug 13 04:33:46.096010 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 362/739] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:45 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:46.149351 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7955be6f-48f9-402c-be4b-c9ef8ee3e78f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:46.150220 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7955be6f-48f9-402c-be4b-c9ef8ee3e78f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:46.157719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7955be6f-48f9-402c-be4b-c9ef8ee3e78f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:46.158173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7955be6f-48f9-402c-be4b-c9ef8ee3e78f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:46.158973 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7955be6f-48f9-402c-be4b-c9ef8ee3e78f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:46.159586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7955be6f-48f9-402c-be4b-c9ef8ee3e78f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:46.187370 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-47e17123-25e1-4468-8ffc-9ded5e1f56d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:46.195069 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-47e17123-25e1-4468-8ffc-9ded5e1f56d6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.151033 Aug 13 04:33:46.195890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 378/740] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:46 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:46.288515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7955be6f-48f9-402c-be4b-c9ef8ee3e78f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:46.295730 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7955be6f-48f9-402c-be4b-c9ef8ee3e78f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.150478 Aug 13 04:33:46.296290 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 363/741] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:46 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:46.328973 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7a60d8c3-b273-46e6-97d0-9cde79d97ef5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:46.329796 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7a60d8c3-b273-46e6-97d0-9cde79d97ef5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:46.340135 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a60d8c3-b273-46e6-97d0-9cde79d97ef5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:46.341127 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a60d8c3-b273-46e6-97d0-9cde79d97ef5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:46.344777 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a60d8c3-b273-46e6-97d0-9cde79d97ef5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:46.345690 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7a60d8c3-b273-46e6-97d0-9cde79d97ef5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:46.560494 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7a60d8c3-b273-46e6-97d0-9cde79d97ef5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:46.568784 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7a60d8c3-b273-46e6-97d0-9cde79d97ef5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.244010 Aug 13 04:33:46.569404 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 379/742] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:46 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:46.868500 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7641f90f-f189-43f5-bb95-ecdf538525a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:46.869137 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7641f90f-f189-43f5-bb95-ecdf538525a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:46.874887 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7641f90f-f189-43f5-bb95-ecdf538525a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:46.875315 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7641f90f-f189-43f5-bb95-ecdf538525a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:46.876208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7641f90f-f189-43f5-bb95-ecdf538525a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:46.876635 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7641f90f-f189-43f5-bb95-ecdf538525a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.061565 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-61be2c47-d590-46e6-a65b-28c2e5a4bd72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:47.063008 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-61be2c47-d590-46e6-a65b-28c2e5a4bd72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:47.074602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-61be2c47-d590-46e6-a65b-28c2e5a4bd72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:47.075510 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-61be2c47-d590-46e6-a65b-28c2e5a4bd72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.075829 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-61be2c47-d590-46e6-a65b-28c2e5a4bd72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:47.076263 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-61be2c47-d590-46e6-a65b-28c2e5a4bd72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.090819 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7641f90f-f189-43f5-bb95-ecdf538525a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:47.101323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7641f90f-f189-43f5-bb95-ecdf538525a3 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.236316 Aug 13 04:33:47.102713 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 364/743] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:46 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:47.116633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2c5e446d-623d-401f-ace0-5c9ccfdfb840 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:47.117310 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2c5e446d-623d-401f-ace0-5c9ccfdfb840 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:47.124324 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c5e446d-623d-401f-ace0-5c9ccfdfb840 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:47.124783 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c5e446d-623d-401f-ace0-5c9ccfdfb840 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.125661 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c5e446d-623d-401f-ace0-5c9ccfdfb840 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:47.126103 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c5e446d-623d-401f-ace0-5c9ccfdfb840 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.358700 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-61be2c47-d590-46e6-a65b-28c2e5a4bd72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:47.367831 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-61be2c47-d590-46e6-a65b-28c2e5a4bd72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:47.369341 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-61be2c47-d590-46e6-a65b-28c2e5a4bd72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:47.370573 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-61be2c47-d590-46e6-a65b-28c2e5a4bd72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.313255 Aug 13 04:33:47.371170 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 380/744] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:47 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:33:47.375719 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-640189e4-23ba-4889-a194-afaf6d692186 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:47.376341 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-640189e4-23ba-4889-a194-afaf6d692186 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:47.384320 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-640189e4-23ba-4889-a194-afaf6d692186 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:47.385076 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-640189e4-23ba-4889-a194-afaf6d692186 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.386470 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-640189e4-23ba-4889-a194-afaf6d692186 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:47.386470 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-640189e4-23ba-4889-a194-afaf6d692186 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.393816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2c5e446d-623d-401f-ace0-5c9ccfdfb840 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:47.402383 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2c5e446d-623d-401f-ace0-5c9ccfdfb840 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.290224 Aug 13 04:33:47.403428 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 365/745] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:47 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:47.408132 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-12b1bf50-7a84-489b-9c9e-f2a83848a94e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:47.408716 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-12b1bf50-7a84-489b-9c9e-f2a83848a94e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:47.415080 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-12b1bf50-7a84-489b-9c9e-f2a83848a94e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:47.415536 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-12b1bf50-7a84-489b-9c9e-f2a83848a94e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.416355 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-12b1bf50-7a84-489b-9c9e-f2a83848a94e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:47.416795 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-12b1bf50-7a84-489b-9c9e-f2a83848a94e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.575380 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-640189e4-23ba-4889-a194-afaf6d692186 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:47.582923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-12b1bf50-7a84-489b-9c9e-f2a83848a94e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:47.583120 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-640189e4-23ba-4889-a194-afaf6d692186 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.210827 Aug 13 04:33:47.583732 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 381/746] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:47 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:47.587908 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b9d4d6c9-9d4c-4609-bda5-5bec408fce7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:47.588516 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b9d4d6c9-9d4c-4609-bda5-5bec408fce7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:47.594602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9d4d6c9-9d4c-4609-bda5-5bec408fce7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:47.595048 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9d4d6c9-9d4c-4609-bda5-5bec408fce7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.595849 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9d4d6c9-9d4c-4609-bda5-5bec408fce7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:47.596276 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b9d4d6c9-9d4c-4609-bda5-5bec408fce7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:47.597812 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-12b1bf50-7a84-489b-9c9e-f2a83848a94e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1509 microversion: 2.1 time: 0.193300 Aug 13 04:33:47.598503 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 366/747] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:47 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1509 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:47.725756 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b9d4d6c9-9d4c-4609-bda5-5bec408fce7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:47.732944 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b9d4d6c9-9d4c-4609-bda5-5bec408fce7b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.148389 Aug 13 04:33:47.733566 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 382/748] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:47 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:48.118141 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-049c1c6d-490a-44de-a6b2-f3bc544a8a98 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:48.118752 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-049c1c6d-490a-44de-a6b2-f3bc544a8a98 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:48.124574 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-049c1c6d-490a-44de-a6b2-f3bc544a8a98 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.125021 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-049c1c6d-490a-44de-a6b2-f3bc544a8a98 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.125814 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-049c1c6d-490a-44de-a6b2-f3bc544a8a98 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.126247 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-049c1c6d-490a-44de-a6b2-f3bc544a8a98 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.247484 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-049c1c6d-490a-44de-a6b2-f3bc544a8a98 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:48.256700 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-049c1c6d-490a-44de-a6b2-f3bc544a8a98 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1511 microversion: 2.1 time: 0.142143 Aug 13 04:33:48.257267 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 367/749] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:48 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1511 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:48.390816 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8ae9b358-9b03-42fa-8772-fc073cfb25e1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:48.391427 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8ae9b358-9b03-42fa-8772-fc073cfb25e1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:48.396355 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5b3507fd-9f0d-4ad2-b3b7-f846a3e29ca6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:48.398781 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8ae9b358-9b03-42fa-8772-fc073cfb25e1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.399370 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8ae9b358-9b03-42fa-8772-fc073cfb25e1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.400393 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8ae9b358-9b03-42fa-8772-fc073cfb25e1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.401156 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8ae9b358-9b03-42fa-8772-fc073cfb25e1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.401449 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5b3507fd-9f0d-4ad2-b3b7-f846a3e29ca6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.402187 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5b3507fd-9f0d-4ad2-b3b7-f846a3e29ca6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.426807 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5b3507fd-9f0d-4ad2-b3b7-f846a3e29ca6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Going to try to stop instance {{(pid=108288) force_stop /opt/stack/nova/nova/compute/api.py:2580}} Aug 13 04:33:48.468693 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5b3507fd-9f0d-4ad2-b3b7-f846a3e29ca6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 202 len: 0 microversion: 2.1 time: 0.078774 Aug 13 04:33:48.469657 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 368/750] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:33:48 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:33:48.474769 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-05f8591e-8a49-4519-bca9-74a79f91f454 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:48.475471 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-05f8591e-8a49-4519-bca9-74a79f91f454 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:48.481714 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-05f8591e-8a49-4519-bca9-74a79f91f454 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.482161 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-05f8591e-8a49-4519-bca9-74a79f91f454 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.482943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-05f8591e-8a49-4519-bca9-74a79f91f454 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.483385 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-05f8591e-8a49-4519-bca9-74a79f91f454 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.572015 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8ae9b358-9b03-42fa-8772-fc073cfb25e1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:48.580523 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8ae9b358-9b03-42fa-8772-fc073cfb25e1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:48.582211 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8ae9b358-9b03-42fa-8772-fc073cfb25e1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:48.583425 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8ae9b358-9b03-42fa-8772-fc073cfb25e1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.196580 Aug 13 04:33:48.584104 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 383/751] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:48 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:33:48.588719 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d956dc48-83fe-4670-80d8-ce911437b48c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:48.589367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d956dc48-83fe-4670-80d8-ce911437b48c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:48.596053 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d956dc48-83fe-4670-80d8-ce911437b48c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.597118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d956dc48-83fe-4670-80d8-ce911437b48c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.597927 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d956dc48-83fe-4670-80d8-ce911437b48c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.598386 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d956dc48-83fe-4670-80d8-ce911437b48c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.681820 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-05f8591e-8a49-4519-bca9-74a79f91f454 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:48.689671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-05f8591e-8a49-4519-bca9-74a79f91f454 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.218557 Aug 13 04:33:48.699634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 369/752] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:48 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:48.699634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2e4b4115-1e1f-4090-86be-e08b60533793 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:48.699634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2e4b4115-1e1f-4090-86be-e08b60533793 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:48.701544 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e4b4115-1e1f-4090-86be-e08b60533793 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.702018 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e4b4115-1e1f-4090-86be-e08b60533793 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.702867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e4b4115-1e1f-4090-86be-e08b60533793 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.703304 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e4b4115-1e1f-4090-86be-e08b60533793 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.828447 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d956dc48-83fe-4670-80d8-ce911437b48c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:48.836635 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d956dc48-83fe-4670-80d8-ce911437b48c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1675 microversion: 2.1 time: 0.251491 Aug 13 04:33:48.837213 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 384/753] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:48 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:48.841519 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ad7b0ff6-fa79-46ee-9ffc-8f4601db4d4a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:48.842119 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ad7b0ff6-fa79-46ee-9ffc-8f4601db4d4a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:48.849070 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ad7b0ff6-fa79-46ee-9ffc-8f4601db4d4a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.849550 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ad7b0ff6-fa79-46ee-9ffc-8f4601db4d4a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.850321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ad7b0ff6-fa79-46ee-9ffc-8f4601db4d4a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:48.850757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ad7b0ff6-fa79-46ee-9ffc-8f4601db4d4a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:48.981231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2e4b4115-1e1f-4090-86be-e08b60533793 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:48.989363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2e4b4115-1e1f-4090-86be-e08b60533793 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.297811 Aug 13 04:33:48.998943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 370/754] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:48 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:48.998943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e473caa1-47e4-442e-a171-361986f9e911 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:48.998943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e473caa1-47e4-442e-a171-361986f9e911 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:49.002022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e473caa1-47e4-442e-a171-361986f9e911 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.002263 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e473caa1-47e4-442e-a171-361986f9e911 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.003666 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e473caa1-47e4-442e-a171-361986f9e911 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.004104 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e473caa1-47e4-442e-a171-361986f9e911 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.124943 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ad7b0ff6-fa79-46ee-9ffc-8f4601db4d4a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:49.132720 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ad7b0ff6-fa79-46ee-9ffc-8f4601db4d4a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1515 microversion: 2.1 time: 0.294484 Aug 13 04:33:49.133379 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 385/755] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:48 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1515 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:49.229173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e473caa1-47e4-442e-a171-361986f9e911 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:49.238929 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e473caa1-47e4-442e-a171-361986f9e911 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.247891 Aug 13 04:33:49.239675 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 371/756] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:48 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:49.274915 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0db2e888-be66-45be-a009-ba55ca19c412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:49.275600 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0db2e888-be66-45be-a009-ba55ca19c412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:49.281500 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0db2e888-be66-45be-a009-ba55ca19c412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.282139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0db2e888-be66-45be-a009-ba55ca19c412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.283163 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0db2e888-be66-45be-a009-ba55ca19c412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.283728 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0db2e888-be66-45be-a009-ba55ca19c412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.391617 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0db2e888-be66-45be-a009-ba55ca19c412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:49.416455 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0db2e888-be66-45be-a009-ba55ca19c412 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 200 len: 1469 microversion: 2.1 time: 0.145521 Aug 13 04:33:49.417071 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 386/757] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:49 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 1469 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:49.432218 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-6588eac3-6f58-48f2-8123-537885551a1e req-141750b5-0e9f-40fc-aa84-fd944b5daf77 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "17d3fbfa-ac7d-47d6-9682-00405fcb9a3f", "name": "network-vif-deleted", "tag": "4eb63f7d-d59b-4c2c-928b-eaf2bb3b7564"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:49.433930 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:49.433930 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:33:49.442180 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-6588eac3-6f58-48f2-8123-537885551a1e req-141750b5-0e9f-40fc-aa84-fd944b5daf77 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.442897 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-6588eac3-6f58-48f2-8123-537885551a1e req-141750b5-0e9f-40fc-aa84-fd944b5daf77 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.458096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-6588eac3-6f58-48f2-8123-537885551a1e req-141750b5-0e9f-40fc-aa84-fd944b5daf77 service nova] Creating event network-vif-deleted:4eb63f7d-d59b-4c2c-928b-eaf2bb3b7564 for instance 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f on hv-cinder-75996 Aug 13 04:33:49.463120 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-6588eac3-6f58-48f2-8123-537885551a1e req-141750b5-0e9f-40fc-aa84-fd944b5daf77 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034420 Aug 13 04:33:49.464205 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 372/758] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:49 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:49.602211 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ef59a9b8-c39e-47ee-ad2b-80bf1a2e6864 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:49.602926 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ef59a9b8-c39e-47ee-ad2b-80bf1a2e6864 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:49.608732 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ef59a9b8-c39e-47ee-ad2b-80bf1a2e6864 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.609604 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ef59a9b8-c39e-47ee-ad2b-80bf1a2e6864 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.610399 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ef59a9b8-c39e-47ee-ad2b-80bf1a2e6864 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.610824 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ef59a9b8-c39e-47ee-ad2b-80bf1a2e6864 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.707645 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-98036787-47e4-409d-a15f-fb7184bc7702 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:49.708363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-98036787-47e4-409d-a15f-fb7184bc7702 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:49.715789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-98036787-47e4-409d-a15f-fb7184bc7702 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.716230 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-98036787-47e4-409d-a15f-fb7184bc7702 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.716997 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-98036787-47e4-409d-a15f-fb7184bc7702 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.717462 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-98036787-47e4-409d-a15f-fb7184bc7702 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.758511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ef59a9b8-c39e-47ee-ad2b-80bf1a2e6864 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:49.767450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ef59a9b8-c39e-47ee-ad2b-80bf1a2e6864 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:49.769250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ef59a9b8-c39e-47ee-ad2b-80bf1a2e6864 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:49.770435 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ef59a9b8-c39e-47ee-ad2b-80bf1a2e6864 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.172173 Aug 13 04:33:49.771474 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 387/759] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:49 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:49.853669 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e5d51b87-b729-4152-9979-0a650d7a7ebd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:49.854356 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e5d51b87-b729-4152-9979-0a650d7a7ebd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:49.860368 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e5d51b87-b729-4152-9979-0a650d7a7ebd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.860536 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-98036787-47e4-409d-a15f-fb7184bc7702 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:49.860890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e5d51b87-b729-4152-9979-0a650d7a7ebd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.861891 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e5d51b87-b729-4152-9979-0a650d7a7ebd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:49.862876 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e5d51b87-b729-4152-9979-0a650d7a7ebd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:49.877143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-98036787-47e4-409d-a15f-fb7184bc7702 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.173616 Aug 13 04:33:49.878182 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 373/760] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:49 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:50.007680 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ee45035a-501f-4e46-bbbf-9871ccfd8bb7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:50.010265 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ee45035a-501f-4e46-bbbf-9871ccfd8bb7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:50.015487 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e5d51b87-b729-4152-9979-0a650d7a7ebd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:50.020949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee45035a-501f-4e46-bbbf-9871ccfd8bb7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.021938 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee45035a-501f-4e46-bbbf-9871ccfd8bb7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.023148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee45035a-501f-4e46-bbbf-9871ccfd8bb7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.023918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee45035a-501f-4e46-bbbf-9871ccfd8bb7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.025519 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e5d51b87-b729-4152-9979-0a650d7a7ebd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1675 microversion: 2.1 time: 0.174996 Aug 13 04:33:50.026635 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 388/761] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:49 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1675 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:50.173962 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ee45035a-501f-4e46-bbbf-9871ccfd8bb7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:50.181386 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ee45035a-501f-4e46-bbbf-9871ccfd8bb7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.178746 Aug 13 04:33:50.181973 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 374/762] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:50 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:50.256906 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-845bc3cd-fb8b-419b-8d55-0f68757f447c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:50.257558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-845bc3cd-fb8b-419b-8d55-0f68757f447c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:50.263504 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-845bc3cd-fb8b-419b-8d55-0f68757f447c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.263897 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-845bc3cd-fb8b-419b-8d55-0f68757f447c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.264674 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-845bc3cd-fb8b-419b-8d55-0f68757f447c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.265111 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-845bc3cd-fb8b-419b-8d55-0f68757f447c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.385547 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-845bc3cd-fb8b-419b-8d55-0f68757f447c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:50.392790 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-845bc3cd-fb8b-419b-8d55-0f68757f447c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.140821 Aug 13 04:33:50.393650 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 389/763] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:50 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:50.433027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2e2b9b7f-1066-4093-9b04-5686b621793e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:50.433667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2e2b9b7f-1066-4093-9b04-5686b621793e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:50.441021 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e2b9b7f-1066-4093-9b04-5686b621793e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.441512 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e2b9b7f-1066-4093-9b04-5686b621793e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.442286 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e2b9b7f-1066-4093-9b04-5686b621793e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.442723 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e2b9b7f-1066-4093-9b04-5686b621793e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.455860 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-2e2b9b7f-1066-4093-9b04-5686b621793e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] HTTP exception thrown: Instance 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f could not be found. Aug 13 04:33:50.456442 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2e2b9b7f-1066-4093-9b04-5686b621793e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Returning 404 to user: Instance 17d3fbfa-ac7d-47d6-9682-00405fcb9a3f could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:33:50.457281 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2e2b9b7f-1066-4093-9b04-5686b621793e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f" status: 404 len: 111 microversion: 2.1 time: 0.027993 Aug 13 04:33:50.457831 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 375/764] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:50 2021] GET /compute/v2.1/servers/17d3fbfa-ac7d-47d6-9682-00405fcb9a3f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:33:50.585501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8f274a2e-f2b3-43e1-b03e-e824cf5d2554 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:50.586181 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8f274a2e-f2b3-43e1-b03e-e824cf5d2554 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:50.592264 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8f274a2e-f2b3-43e1-b03e-e824cf5d2554 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.592719 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8f274a2e-f2b3-43e1-b03e-e824cf5d2554 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.593524 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8f274a2e-f2b3-43e1-b03e-e824cf5d2554 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.593967 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8f274a2e-f2b3-43e1-b03e-e824cf5d2554 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.724763 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8f274a2e-f2b3-43e1-b03e-e824cf5d2554 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:50.731575 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8f274a2e-f2b3-43e1-b03e-e824cf5d2554 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1515 microversion: 2.1 time: 0.149541 Aug 13 04:33:50.734538 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 390/765] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:50 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1515 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:50.750127 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-dcbcfcba-0000-473d-8bcc-16a41cbcd44b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92f369e5-1aab-4b2e-befa-5d5380ad6726"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:50.751610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-dcbcfcba-0000-473d-8bcc-16a41cbcd44b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:50.757760 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dcbcfcba-0000-473d-8bcc-16a41cbcd44b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.758284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dcbcfcba-0000-473d-8bcc-16a41cbcd44b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.759271 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dcbcfcba-0000-473d-8bcc-16a41cbcd44b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.759769 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dcbcfcba-0000-473d-8bcc-16a41cbcd44b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.789232 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ab49a225-16a6-4b8a-b8f8-cbcafba15e9f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:50.790065 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ab49a225-16a6-4b8a-b8f8-cbcafba15e9f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:50.796905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ab49a225-16a6-4b8a-b8f8-cbcafba15e9f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.797684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ab49a225-16a6-4b8a-b8f8-cbcafba15e9f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.798636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ab49a225-16a6-4b8a-b8f8-cbcafba15e9f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.799083 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ab49a225-16a6-4b8a-b8f8-cbcafba15e9f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.942393 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ab49a225-16a6-4b8a-b8f8-cbcafba15e9f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:50.950735 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ab49a225-16a6-4b8a-b8f8-cbcafba15e9f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:50.952464 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ab49a225-16a6-4b8a-b8f8-cbcafba15e9f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:50.953724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ab49a225-16a6-4b8a-b8f8-cbcafba15e9f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.168969 Aug 13 04:33:50.954367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 391/766] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:50 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:33:50.969797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e6fae62a-7602-4b32-96c4-839d43409fb7 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:50.970486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e6fae62a-7602-4b32-96c4-839d43409fb7 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:50.977267 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e6fae62a-7602-4b32-96c4-839d43409fb7 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.977798 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e6fae62a-7602-4b32-96c4-839d43409fb7 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:50.978602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e6fae62a-7602-4b32-96c4-839d43409fb7 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:50.979044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e6fae62a-7602-4b32-96c4-839d43409fb7 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.017043 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-dcbcfcba-0000-473d-8bcc-16a41cbcd44b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.270141 Aug 13 04:33:51.017694 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 376/767] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:33:50 2021] POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments => generated 194 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:51.045569 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5d8c3a0e-ec48-4e81-ae9c-f14a83445f79 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:51.046352 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5d8c3a0e-ec48-4e81-ae9c-f14a83445f79 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:51.055262 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d8c3a0e-ec48-4e81-ae9c-f14a83445f79 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.060179 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d8c3a0e-ec48-4e81-ae9c-f14a83445f79 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.061078 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d8c3a0e-ec48-4e81-ae9c-f14a83445f79 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.061661 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d8c3a0e-ec48-4e81-ae9c-f14a83445f79 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.116250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e6fae62a-7602-4b32-96c4-839d43409fb7 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:51.125592 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e6fae62a-7602-4b32-96c4-839d43409fb7 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.159084 Aug 13 04:33:51.126528 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 392/768] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:50 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:51.199530 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-748d6865-4fab-4b8f-8fd7-9b8c9b4427df tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:51.200377 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-748d6865-4fab-4b8f-8fd7-9b8c9b4427df tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:51.204729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5d8c3a0e-ec48-4e81-ae9c-f14a83445f79 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:51.206966 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-748d6865-4fab-4b8f-8fd7-9b8c9b4427df tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.207492 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-748d6865-4fab-4b8f-8fd7-9b8c9b4427df tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.208371 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-748d6865-4fab-4b8f-8fd7-9b8c9b4427df tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.208877 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-748d6865-4fab-4b8f-8fd7-9b8c9b4427df tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.212292 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5d8c3a0e-ec48-4e81-ae9c-f14a83445f79 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1675 microversion: 2.1 time: 0.172552 Aug 13 04:33:51.214384 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 377/769] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:51 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:51.338304 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-748d6865-4fab-4b8f-8fd7-9b8c9b4427df tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:51.345634 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-748d6865-4fab-4b8f-8fd7-9b8c9b4427df tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.150881 Aug 13 04:33:51.346182 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 393/770] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:51 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:51.410632 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a6844c40-c23b-4c7c-8cf9-609a7c12b301 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:51.411255 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a6844c40-c23b-4c7c-8cf9-609a7c12b301 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:51.417442 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6844c40-c23b-4c7c-8cf9-609a7c12b301 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.417836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6844c40-c23b-4c7c-8cf9-609a7c12b301 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.418608 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6844c40-c23b-4c7c-8cf9-609a7c12b301 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.419038 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a6844c40-c23b-4c7c-8cf9-609a7c12b301 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.546452 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a6844c40-c23b-4c7c-8cf9-609a7c12b301 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:51.554092 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a6844c40-c23b-4c7c-8cf9-609a7c12b301 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.148443 Aug 13 04:33:51.554662 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 378/771] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:51 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:51.596684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e4de8e6d-9217-4369-8e38-6c35f5ac6e5a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:51.597406 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e4de8e6d-9217-4369-8e38-6c35f5ac6e5a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:51.603528 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e4de8e6d-9217-4369-8e38-6c35f5ac6e5a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.604062 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e4de8e6d-9217-4369-8e38-6c35f5ac6e5a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.604906 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e4de8e6d-9217-4369-8e38-6c35f5ac6e5a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.605414 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e4de8e6d-9217-4369-8e38-6c35f5ac6e5a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.632388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e4de8e6d-9217-4369-8e38-6c35f5ac6e5a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:33:51.710731 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e4de8e6d-9217-4369-8e38-6c35f5ac6e5a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 204 len: 0 microversion: 2.1 time: 0.118397 Aug 13 04:33:51.711406 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 394/772] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:33:51 2021] DELETE /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:33:51.719294 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-787d2d21-c226-4ce4-8484-61154232cdeb tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:51.719902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-787d2d21-c226-4ce4-8484-61154232cdeb tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:51.726060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-787d2d21-c226-4ce4-8484-61154232cdeb tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.726499 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-787d2d21-c226-4ce4-8484-61154232cdeb tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.727260 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-787d2d21-c226-4ce4-8484-61154232cdeb tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.727683 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-787d2d21-c226-4ce4-8484-61154232cdeb tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.847737 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-787d2d21-c226-4ce4-8484-61154232cdeb tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:51.855687 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-787d2d21-c226-4ce4-8484-61154232cdeb tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1513 microversion: 2.1 time: 0.140015 Aug 13 04:33:51.856298 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 379/773] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:51 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1513 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:51.973222 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f69871b2-058f-457c-aa59-777e6ffd3e00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:51.973951 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f69871b2-058f-457c-aa59-777e6ffd3e00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:51.979934 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f69871b2-058f-457c-aa59-777e6ffd3e00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.980381 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f69871b2-058f-457c-aa59-777e6ffd3e00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:51.981142 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f69871b2-058f-457c-aa59-777e6ffd3e00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:51.981611 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f69871b2-058f-457c-aa59-777e6ffd3e00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:52.110909 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f69871b2-058f-457c-aa59-777e6ffd3e00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:52.120721 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f69871b2-058f-457c-aa59-777e6ffd3e00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:52.122354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f69871b2-058f-457c-aa59-777e6ffd3e00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:52.123626 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f69871b2-058f-457c-aa59-777e6ffd3e00 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.154996 Aug 13 04:33:52.124319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 395/774] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:51 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:52.141541 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d6263965-622c-4750-b6da-990262f24a81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:52.142163 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d6263965-622c-4750-b6da-990262f24a81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:52.148511 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6263965-622c-4750-b6da-990262f24a81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:52.148892 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6263965-622c-4750-b6da-990262f24a81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:52.149711 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6263965-622c-4750-b6da-990262f24a81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:52.150148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6263965-622c-4750-b6da-990262f24a81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:52.228445 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c3b2d75a-47af-45dc-b313-1d4f5c887f78 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:52.229062 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c3b2d75a-47af-45dc-b313-1d4f5c887f78 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:52.235132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c3b2d75a-47af-45dc-b313-1d4f5c887f78 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:52.235574 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c3b2d75a-47af-45dc-b313-1d4f5c887f78 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:52.236347 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c3b2d75a-47af-45dc-b313-1d4f5c887f78 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:52.236831 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c3b2d75a-47af-45dc-b313-1d4f5c887f78 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:52.278019 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d6263965-622c-4750-b6da-990262f24a81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:52.285461 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d6263965-622c-4750-b6da-990262f24a81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.147521 Aug 13 04:33:52.286140 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 380/775] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:52 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:52.362833 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b4dcd522-9a32-40d6-8484-bc9df157cd11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:52.363184 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c3b2d75a-47af-45dc-b313-1d4f5c887f78 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:52.363450 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b4dcd522-9a32-40d6-8484-bc9df157cd11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:52.369514 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4dcd522-9a32-40d6-8484-bc9df157cd11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:52.369972 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4dcd522-9a32-40d6-8484-bc9df157cd11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:52.370493 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c3b2d75a-47af-45dc-b313-1d4f5c887f78 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1675 microversion: 2.1 time: 0.145750 Aug 13 04:33:52.370748 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4dcd522-9a32-40d6-8484-bc9df157cd11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:52.371063 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 396/776] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:52 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:52.371194 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4dcd522-9a32-40d6-8484-bc9df157cd11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:52.502595 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b4dcd522-9a32-40d6-8484-bc9df157cd11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:52.510072 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b4dcd522-9a32-40d6-8484-bc9df157cd11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.151019 Aug 13 04:33:52.510639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 381/777] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:52 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:52.571130 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5d0fcf74-15ae-4e53-812d-be86a7066a0f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:52.571736 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5d0fcf74-15ae-4e53-812d-be86a7066a0f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:52.577691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d0fcf74-15ae-4e53-812d-be86a7066a0f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:52.578139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d0fcf74-15ae-4e53-812d-be86a7066a0f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:52.578908 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d0fcf74-15ae-4e53-812d-be86a7066a0f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:52.579366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d0fcf74-15ae-4e53-812d-be86a7066a0f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:52.699601 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5d0fcf74-15ae-4e53-812d-be86a7066a0f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:52.708016 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5d0fcf74-15ae-4e53-812d-be86a7066a0f tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.140646 Aug 13 04:33:52.708614 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 397/778] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:52 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:52.874251 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-096857ba-5be8-4575-987d-9e6819cd3083 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:52.874869 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-096857ba-5be8-4575-987d-9e6819cd3083 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:52.880804 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-096857ba-5be8-4575-987d-9e6819cd3083 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:52.881195 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-096857ba-5be8-4575-987d-9e6819cd3083 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:52.882001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-096857ba-5be8-4575-987d-9e6819cd3083 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:52.882438 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-096857ba-5be8-4575-987d-9e6819cd3083 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.005752 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-096857ba-5be8-4575-987d-9e6819cd3083 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:53.013624 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-096857ba-5be8-4575-987d-9e6819cd3083 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1513 microversion: 2.1 time: 0.143286 Aug 13 04:33:53.014176 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 382/779] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:52 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1513 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:53.142908 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ae6e4e15-1315-48a8-80f6-d8fdbdd8a1d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:53.144495 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ae6e4e15-1315-48a8-80f6-d8fdbdd8a1d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:53.150418 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae6e4e15-1315-48a8-80f6-d8fdbdd8a1d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.150866 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae6e4e15-1315-48a8-80f6-d8fdbdd8a1d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.151632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae6e4e15-1315-48a8-80f6-d8fdbdd8a1d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.152068 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ae6e4e15-1315-48a8-80f6-d8fdbdd8a1d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.277250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ae6e4e15-1315-48a8-80f6-d8fdbdd8a1d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:53.285672 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ae6e4e15-1315-48a8-80f6-d8fdbdd8a1d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:53.287149 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ae6e4e15-1315-48a8-80f6-d8fdbdd8a1d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:53.288266 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ae6e4e15-1315-48a8-80f6-d8fdbdd8a1d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.149403 Aug 13 04:33:53.288817 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 398/780] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:53 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:53.302072 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-89a1d5b8-a342-4b3f-b89d-a49a3ee64e81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:53.302690 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-89a1d5b8-a342-4b3f-b89d-a49a3ee64e81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:53.308634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-89a1d5b8-a342-4b3f-b89d-a49a3ee64e81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.309076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-89a1d5b8-a342-4b3f-b89d-a49a3ee64e81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.310000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-89a1d5b8-a342-4b3f-b89d-a49a3ee64e81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.310442 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-89a1d5b8-a342-4b3f-b89d-a49a3ee64e81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.387038 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a3d7750f-ac27-4629-a854-45afa9251dbc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:53.387654 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a3d7750f-ac27-4629-a854-45afa9251dbc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:53.393638 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a3d7750f-ac27-4629-a854-45afa9251dbc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.394021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a3d7750f-ac27-4629-a854-45afa9251dbc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.394797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a3d7750f-ac27-4629-a854-45afa9251dbc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.395241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a3d7750f-ac27-4629-a854-45afa9251dbc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.430135 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-89a1d5b8-a342-4b3f-b89d-a49a3ee64e81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:53.438005 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-89a1d5b8-a342-4b3f-b89d-a49a3ee64e81 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.139508 Aug 13 04:33:53.438815 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 383/781] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:53 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:53.527253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f246b05d-b3b9-472f-ae5e-e03830158228 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:53.527938 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a3d7750f-ac27-4629-a854-45afa9251dbc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:53.528061 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f246b05d-b3b9-472f-ae5e-e03830158228 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:53.534334 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f246b05d-b3b9-472f-ae5e-e03830158228 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.534972 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f246b05d-b3b9-472f-ae5e-e03830158228 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.535787 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a3d7750f-ac27-4629-a854-45afa9251dbc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1675 microversion: 2.1 time: 0.152416 Aug 13 04:33:53.535926 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f246b05d-b3b9-472f-ae5e-e03830158228 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.536640 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 399/782] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:53 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:53.536768 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f246b05d-b3b9-472f-ae5e-e03830158228 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.591140 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-fbc7d76c-7863-41fd-ad3c-3b8ec3363f55 req-d2a34a7b-eab6-44a3-80f4-38755e600d48 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba719a9-61df-4d8d-99c1-907f97a80e8e", "name": "network-vif-plugged", "status": "completed", "tag": "1166ab58-4fa6-49a1-b301-c03b411d9dc0"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:53.595772 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:53.595772 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:33:53.604571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-fbc7d76c-7863-41fd-ad3c-3b8ec3363f55 req-d2a34a7b-eab6-44a3-80f4-38755e600d48 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.605014 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-fbc7d76c-7863-41fd-ad3c-3b8ec3363f55 req-d2a34a7b-eab6-44a3-80f4-38755e600d48 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.617338 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-fbc7d76c-7863-41fd-ad3c-3b8ec3363f55 req-d2a34a7b-eab6-44a3-80f4-38755e600d48 service nova] Creating event network-vif-plugged:1166ab58-4fa6-49a1-b301-c03b411d9dc0 for instance 5ba719a9-61df-4d8d-99c1-907f97a80e8e on hv-cinder-75996 Aug 13 04:33:53.628662 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-fbc7d76c-7863-41fd-ad3c-3b8ec3363f55 req-d2a34a7b-eab6-44a3-80f4-38755e600d48 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040526 Aug 13 04:33:53.629284 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 400/783] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:53 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:33:53.724887 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b2f359e1-ea4f-4b49-a549-57ba23e87f67 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:53.725739 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b2f359e1-ea4f-4b49-a549-57ba23e87f67 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:53.731610 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b2f359e1-ea4f-4b49-a549-57ba23e87f67 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.732078 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b2f359e1-ea4f-4b49-a549-57ba23e87f67 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.732820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b2f359e1-ea4f-4b49-a549-57ba23e87f67 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:53.733249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b2f359e1-ea4f-4b49-a549-57ba23e87f67 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:53.749865 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f246b05d-b3b9-472f-ae5e-e03830158228 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:53.762414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f246b05d-b3b9-472f-ae5e-e03830158228 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.238389 Aug 13 04:33:53.763958 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 384/784] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:53 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:54.010642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b2f359e1-ea4f-4b49-a549-57ba23e87f67 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:54.018891 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b2f359e1-ea4f-4b49-a549-57ba23e87f67 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1260 microversion: 2.1 time: 0.298316 Aug 13 04:33:54.019614 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 401/785] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:53 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1260 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:54.031906 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3df2a987-c77b-40ba-89ba-caa01a47c97d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:54.032723 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3df2a987-c77b-40ba-89ba-caa01a47c97d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:54.039452 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3df2a987-c77b-40ba-89ba-caa01a47c97d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.040175 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3df2a987-c77b-40ba-89ba-caa01a47c97d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.040971 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3df2a987-c77b-40ba-89ba-caa01a47c97d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.041683 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3df2a987-c77b-40ba-89ba-caa01a47c97d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.261069 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3df2a987-c77b-40ba-89ba-caa01a47c97d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:54.262356 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-d41274bb-52b7-4b21-8fe9-11f67535bf51 req-0a9ea8e8-7f8b-4418-9709-9da9bfb89d7e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4a362027-7dd0-4360-92f4-9028fd0081e7", "name": "network-vif-deleted", "tag": "0657054b-1691-465d-9907-ea9e81ae050a"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:54.267994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:54.267994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:33:54.271371 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3df2a987-c77b-40ba-89ba-caa01a47c97d tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 200 len: 1513 microversion: 2.1 time: 0.244944 Aug 13 04:33:54.281403 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 385/786] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:54 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 1513 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:54.288172 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-d41274bb-52b7-4b21-8fe9-11f67535bf51 req-0a9ea8e8-7f8b-4418-9709-9da9bfb89d7e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.288905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-d41274bb-52b7-4b21-8fe9-11f67535bf51 req-0a9ea8e8-7f8b-4418-9709-9da9bfb89d7e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.304258 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-d41274bb-52b7-4b21-8fe9-11f67535bf51 req-0a9ea8e8-7f8b-4418-9709-9da9bfb89d7e service nova] Creating event network-vif-deleted:0657054b-1691-465d-9907-ea9e81ae050a for instance 4a362027-7dd0-4360-92f4-9028fd0081e7 on hv-cinder-75996 Aug 13 04:33:54.307256 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-628e7c47-5c89-4447-84bd-3780b0ddeb03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:54.307939 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-628e7c47-5c89-4447-84bd-3780b0ddeb03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:54.310150 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-d41274bb-52b7-4b21-8fe9-11f67535bf51 req-0a9ea8e8-7f8b-4418-9709-9da9bfb89d7e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059233 Aug 13 04:33:54.310936 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 402/787] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:54 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:33:54.314716 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-628e7c47-5c89-4447-84bd-3780b0ddeb03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.316220 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-628e7c47-5c89-4447-84bd-3780b0ddeb03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.316851 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-628e7c47-5c89-4447-84bd-3780b0ddeb03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.317287 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-628e7c47-5c89-4447-84bd-3780b0ddeb03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.449318 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-628e7c47-5c89-4447-84bd-3780b0ddeb03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:54.456310 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9adb29f9-ea37-462e-a7f1-6d97de04506b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:54.457205 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9adb29f9-ea37-462e-a7f1-6d97de04506b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:54.458313 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-628e7c47-5c89-4447-84bd-3780b0ddeb03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:54.459826 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-628e7c47-5c89-4447-84bd-3780b0ddeb03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:54.460968 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-628e7c47-5c89-4447-84bd-3780b0ddeb03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.158456 Aug 13 04:33:54.461547 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 386/788] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:54 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:54.463455 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9adb29f9-ea37-462e-a7f1-6d97de04506b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.463921 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9adb29f9-ea37-462e-a7f1-6d97de04506b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.464695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9adb29f9-ea37-462e-a7f1-6d97de04506b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.465129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9adb29f9-ea37-462e-a7f1-6d97de04506b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.552043 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7c4bf2af-5af7-4b5c-bd72-52e2848ef5dd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:54.552658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7c4bf2af-5af7-4b5c-bd72-52e2848ef5dd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:54.558656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c4bf2af-5af7-4b5c-bd72-52e2848ef5dd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.559108 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c4bf2af-5af7-4b5c-bd72-52e2848ef5dd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.559889 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c4bf2af-5af7-4b5c-bd72-52e2848ef5dd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.560327 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c4bf2af-5af7-4b5c-bd72-52e2848ef5dd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.593457 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9adb29f9-ea37-462e-a7f1-6d97de04506b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:54.600979 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9adb29f9-ea37-462e-a7f1-6d97de04506b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.149233 Aug 13 04:33:54.601917 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 403/789] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:54 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:54.680853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7c4bf2af-5af7-4b5c-bd72-52e2848ef5dd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:54.688107 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7c4bf2af-5af7-4b5c-bd72-52e2848ef5dd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1675 microversion: 2.1 time: 0.139805 Aug 13 04:33:54.688695 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 387/790] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:54 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1675 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:54.778607 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-753bf410-bb41-4491-a177-046b564a4574 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:54.779215 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-753bf410-bb41-4491-a177-046b564a4574 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:54.785312 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-753bf410-bb41-4491-a177-046b564a4574 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.785792 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-753bf410-bb41-4491-a177-046b564a4574 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.786558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-753bf410-bb41-4491-a177-046b564a4574 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:54.786994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-753bf410-bb41-4491-a177-046b564a4574 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:54.919658 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-753bf410-bb41-4491-a177-046b564a4574 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:54.927159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-753bf410-bb41-4491-a177-046b564a4574 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.152155 Aug 13 04:33:54.927725 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 404/791] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:54 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:55.037626 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-24b15b19-a7ab-4a63-882e-ce8d50b26af5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:55.038263 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-24b15b19-a7ab-4a63-882e-ce8d50b26af5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:55.044555 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-24b15b19-a7ab-4a63-882e-ce8d50b26af5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.045313 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-24b15b19-a7ab-4a63-882e-ce8d50b26af5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.046434 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-24b15b19-a7ab-4a63-882e-ce8d50b26af5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.046878 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-24b15b19-a7ab-4a63-882e-ce8d50b26af5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.172819 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-24b15b19-a7ab-4a63-882e-ce8d50b26af5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:55.180247 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-24b15b19-a7ab-4a63-882e-ce8d50b26af5 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1443 microversion: 2.1 time: 0.147622 Aug 13 04:33:55.180834 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 388/792] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:55 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:55.196905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-806ab320-cf66-4705-937f-3f1f4035851b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:55.197638 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-806ab320-cf66-4705-937f-3f1f4035851b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:55.203729 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-806ab320-cf66-4705-937f-3f1f4035851b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.204212 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-806ab320-cf66-4705-937f-3f1f4035851b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.205009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-806ab320-cf66-4705-937f-3f1f4035851b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.206173 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-806ab320-cf66-4705-937f-3f1f4035851b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.288676 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b23a89ff-8aad-4840-8c78-c670f9e8d98a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:55.289323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b23a89ff-8aad-4840-8c78-c670f9e8d98a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4a362027-7dd0-4360-92f4-9028fd0081e7] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:55.297112 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b23a89ff-8aad-4840-8c78-c670f9e8d98a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.297639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b23a89ff-8aad-4840-8c78-c670f9e8d98a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.298473 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b23a89ff-8aad-4840-8c78-c670f9e8d98a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.298949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b23a89ff-8aad-4840-8c78-c670f9e8d98a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.313851 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-b23a89ff-8aad-4840-8c78-c670f9e8d98a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] HTTP exception thrown: Instance 4a362027-7dd0-4360-92f4-9028fd0081e7 could not be found. Aug 13 04:33:55.315565 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b23a89ff-8aad-4840-8c78-c670f9e8d98a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Returning 404 to user: Instance 4a362027-7dd0-4360-92f4-9028fd0081e7 could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:33:55.316744 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b23a89ff-8aad-4840-8c78-c670f9e8d98a tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7" status: 404 len: 111 microversion: 2.1 time: 0.031916 Aug 13 04:33:55.317732 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 389/793] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:55 2021] GET /compute/v2.1/servers/4a362027-7dd0-4360-92f4-9028fd0081e7 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 13 04:33:55.325093 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-54b15cbc-c9bc-4da7-93d0-0176b93decb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:55.325695 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-54b15cbc-c9bc-4da7-93d0-0176b93decb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:55.332224 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-54b15cbc-c9bc-4da7-93d0-0176b93decb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.332764 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-54b15cbc-c9bc-4da7-93d0-0176b93decb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.332929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-806ab320-cf66-4705-937f-3f1f4035851b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:55.333698 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-54b15cbc-c9bc-4da7-93d0-0176b93decb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.334194 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-54b15cbc-c9bc-4da7-93d0-0176b93decb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.340704 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-806ab320-cf66-4705-937f-3f1f4035851b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1443 microversion: 2.1 time: 0.147646 Aug 13 04:33:55.341277 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 405/794] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:55 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1443 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:55.359236 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-54b15cbc-c9bc-4da7-93d0-0176b93decb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Going to try to terminate instance {{(pid=108288) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:33:55.449234 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-54b15cbc-c9bc-4da7-93d0-0176b93decb0 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "DELETE /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 204 len: 0 microversion: 2.1 time: 0.127528 Aug 13 04:33:55.449945 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 390/795] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:33:55 2021] DELETE /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 13 04:33:55.458558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-22163297-47a8-42bc-a684-bd9ed6f898fa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:55.459185 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-22163297-47a8-42bc-a684-bd9ed6f898fa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:55.465037 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-22163297-47a8-42bc-a684-bd9ed6f898fa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.465543 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-22163297-47a8-42bc-a684-bd9ed6f898fa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.466365 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-22163297-47a8-42bc-a684-bd9ed6f898fa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.466825 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-22163297-47a8-42bc-a684-bd9ed6f898fa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.479800 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a456c8e0-bb8b-42c2-888e-af406ba4a2e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:55.480494 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a456c8e0-bb8b-42c2-888e-af406ba4a2e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:55.487791 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a456c8e0-bb8b-42c2-888e-af406ba4a2e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.488099 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a456c8e0-bb8b-42c2-888e-af406ba4a2e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.489149 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a456c8e0-bb8b-42c2-888e-af406ba4a2e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.489615 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a456c8e0-bb8b-42c2-888e-af406ba4a2e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.899023 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-22163297-47a8-42bc-a684-bd9ed6f898fa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:55.903752 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a456c8e0-bb8b-42c2-888e-af406ba4a2e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:55.906905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-22163297-47a8-42bc-a684-bd9ed6f898fa tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1514 microversion: 2.1 time: 0.452791 Aug 13 04:33:55.907484 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 406/796] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:55 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1514 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:55.912909 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-167490ab-17cf-469a-aa30-b1da87ab0ad1 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:55.913551 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a456c8e0-bb8b-42c2-888e-af406ba4a2e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:55.913794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-167490ab-17cf-469a-aa30-b1da87ab0ad1 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:55.915355 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a456c8e0-bb8b-42c2-888e-af406ba4a2e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:55.916549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a456c8e0-bb8b-42c2-888e-af406ba4a2e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.440922 Aug 13 04:33:55.917362 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 391/797] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:55 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:33:55.921820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-167490ab-17cf-469a-aa30-b1da87ab0ad1 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.922600 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-167490ab-17cf-469a-aa30-b1da87ab0ad1 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.923416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-167490ab-17cf-469a-aa30-b1da87ab0ad1 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.923854 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-167490ab-17cf-469a-aa30-b1da87ab0ad1 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.925071 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-4f0e853a-95b7-4812-92d7-a6f0668c0e57 req-6b275d8c-b108-454d-9008-6f2671caf331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d299e5c1-cd60-4057-93a3-5d32e1908d2f", "name": "network-vif-plugged", "status": "completed", "tag": "c3be48be-e5ee-48ea-a418-bc6c5c7a337c"}, {"server_uuid": "da403df1-360d-41cf-86fd-0b09258785d0", "name": "network-vif-plugged", "status": "completed", "tag": "90912158-5071-4e18-b5b5-6e2227fd5493"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:55.927152 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:55.927152 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:33:55.935248 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-4f0e853a-95b7-4812-92d7-a6f0668c0e57 req-6b275d8c-b108-454d-9008-6f2671caf331 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.935848 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-4f0e853a-95b7-4812-92d7-a6f0668c0e57 req-6b275d8c-b108-454d-9008-6f2671caf331 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.951241 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-4f0e853a-95b7-4812-92d7-a6f0668c0e57 req-6b275d8c-b108-454d-9008-6f2671caf331 service nova] Creating event network-vif-plugged:c3be48be-e5ee-48ea-a418-bc6c5c7a337c for instance d299e5c1-cd60-4057-93a3-5d32e1908d2f on hv-cinder-75996 Aug 13 04:33:55.952038 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-4f0e853a-95b7-4812-92d7-a6f0668c0e57 req-6b275d8c-b108-454d-9008-6f2671caf331 service nova] Creating event network-vif-plugged:90912158-5071-4e18-b5b5-6e2227fd5493 for instance da403df1-360d-41cf-86fd-0b09258785d0 on hv-cinder-75996 Aug 13 04:33:55.958914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-4f0e853a-95b7-4812-92d7-a6f0668c0e57 req-6b275d8c-b108-454d-9008-6f2671caf331 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.040169 Aug 13 04:33:55.960229 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 392/798] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:55 2021] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:55.966125 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3b74d145-5b58-47cc-bc88-e88828e64ad6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:55.966994 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3b74d145-5b58-47cc-bc88-e88828e64ad6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:55.974390 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3b74d145-5b58-47cc-bc88-e88828e64ad6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.975097 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3b74d145-5b58-47cc-bc88-e88828e64ad6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:55.976011 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3b74d145-5b58-47cc-bc88-e88828e64ad6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:55.976596 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3b74d145-5b58-47cc-bc88-e88828e64ad6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:56.121342 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-167490ab-17cf-469a-aa30-b1da87ab0ad1 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:56.132859 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-167490ab-17cf-469a-aa30-b1da87ab0ad1 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.224315 Aug 13 04:33:56.133774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 407/799] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:55 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:56.138327 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e4d72e16-a0ad-456c-a011-b2e09aa785e4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:56.139138 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e4d72e16-a0ad-456c-a011-b2e09aa785e4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:56.153111 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e4d72e16-a0ad-456c-a011-b2e09aa785e4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:56.153848 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e4d72e16-a0ad-456c-a011-b2e09aa785e4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:56.159775 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e4d72e16-a0ad-456c-a011-b2e09aa785e4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:56.159967 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e4d72e16-a0ad-456c-a011-b2e09aa785e4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:56.205936 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3b74d145-5b58-47cc-bc88-e88828e64ad6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:56.216745 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3b74d145-5b58-47cc-bc88-e88828e64ad6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1675 microversion: 2.1 time: 0.255160 Aug 13 04:33:56.217638 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 393/800] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:55 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1675 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:56.329166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e4d72e16-a0ad-456c-a011-b2e09aa785e4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:56.337125 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e4d72e16-a0ad-456c-a011-b2e09aa785e4 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.202051 Aug 13 04:33:56.346611 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 408/801] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:56 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:56.923673 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bdf42b5a-ff6d-4343-b52b-c73482a4e902 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:56.924267 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bdf42b5a-ff6d-4343-b52b-c73482a4e902 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:56.930253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bdf42b5a-ff6d-4343-b52b-c73482a4e902 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:56.930716 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bdf42b5a-ff6d-4343-b52b-c73482a4e902 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:56.931488 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bdf42b5a-ff6d-4343-b52b-c73482a4e902 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:56.931993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bdf42b5a-ff6d-4343-b52b-c73482a4e902 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:56.934634 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-add19d0b-69ca-4fa7-8156-ed743cc3957a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:56.935470 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-add19d0b-69ca-4fa7-8156-ed743cc3957a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:56.942673 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-add19d0b-69ca-4fa7-8156-ed743cc3957a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:56.943125 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-add19d0b-69ca-4fa7-8156-ed743cc3957a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:56.943901 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-add19d0b-69ca-4fa7-8156-ed743cc3957a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:56.944331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-add19d0b-69ca-4fa7-8156-ed743cc3957a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:57.116511 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bdf42b5a-ff6d-4343-b52b-c73482a4e902 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:57.123954 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bdf42b5a-ff6d-4343-b52b-c73482a4e902 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1514 microversion: 2.1 time: 0.203962 Aug 13 04:33:57.124614 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 394/802] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:56 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1514 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:57.135949 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-add19d0b-69ca-4fa7-8156-ed743cc3957a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:57.144587 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-add19d0b-69ca-4fa7-8156-ed743cc3957a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:57.146136 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-add19d0b-69ca-4fa7-8156-ed743cc3957a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:57.147366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-add19d0b-69ca-4fa7-8156-ed743cc3957a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.216964 Aug 13 04:33:57.147922 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 409/803] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:56 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:33:57.149643 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5de2667e-5e2b-4a30-931e-e88c7d97e7ae tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:57.150525 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5de2667e-5e2b-4a30-931e-e88c7d97e7ae tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:57.156540 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5de2667e-5e2b-4a30-931e-e88c7d97e7ae tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:57.156989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5de2667e-5e2b-4a30-931e-e88c7d97e7ae tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:57.157783 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5de2667e-5e2b-4a30-931e-e88c7d97e7ae tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:57.158220 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5de2667e-5e2b-4a30-931e-e88c7d97e7ae tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:57.234408 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-dd44173a-6815-47c2-a5f3-20a30bf078c3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:57.235023 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-dd44173a-6815-47c2-a5f3-20a30bf078c3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:57.241453 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dd44173a-6815-47c2-a5f3-20a30bf078c3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:57.241914 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dd44173a-6815-47c2-a5f3-20a30bf078c3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:57.242898 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dd44173a-6815-47c2-a5f3-20a30bf078c3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:57.243336 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dd44173a-6815-47c2-a5f3-20a30bf078c3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:57.281241 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5de2667e-5e2b-4a30-931e-e88c7d97e7ae tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:57.289651 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5de2667e-5e2b-4a30-931e-e88c7d97e7ae tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1358 microversion: 2.1 time: 0.144085 Aug 13 04:33:57.290328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 395/804] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:57 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1358 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:57.353661 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7629a919-1251-4bb9-b7a9-fb24efd29243 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:57.354591 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7629a919-1251-4bb9-b7a9-fb24efd29243 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:57.361148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7629a919-1251-4bb9-b7a9-fb24efd29243 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:57.361666 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7629a919-1251-4bb9-b7a9-fb24efd29243 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:57.362449 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7629a919-1251-4bb9-b7a9-fb24efd29243 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:57.362879 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7629a919-1251-4bb9-b7a9-fb24efd29243 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:57.373099 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dd44173a-6815-47c2-a5f3-20a30bf078c3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:57.382708 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dd44173a-6815-47c2-a5f3-20a30bf078c3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1675 microversion: 2.1 time: 0.151920 Aug 13 04:33:57.384118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 410/805] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:57 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1675 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:57.505122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7629a919-1251-4bb9-b7a9-fb24efd29243 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:57.512539 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7629a919-1251-4bb9-b7a9-fb24efd29243 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.162519 Aug 13 04:33:57.513108 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 396/806] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:57 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:33:57.588998 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-bd3beade-1786-4b4f-97bd-6c969c867ed6 req-d1b49210-3473-46b5-8103-c7d51dc2d83a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba719a9-61df-4d8d-99c1-907f97a80e8e", "tag": "1166ab58-4fa6-49a1-b301-c03b411d9dc0"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:57.590596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:57.590596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:33:57.597828 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-bd3beade-1786-4b4f-97bd-6c969c867ed6 req-d1b49210-3473-46b5-8103-c7d51dc2d83a service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:57.598267 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-bd3beade-1786-4b4f-97bd-6c969c867ed6 req-d1b49210-3473-46b5-8103-c7d51dc2d83a service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:57.609028 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-bd3beade-1786-4b4f-97bd-6c969c867ed6 req-d1b49210-3473-46b5-8103-c7d51dc2d83a service nova] Creating event network-changed:1166ab58-4fa6-49a1-b301-c03b411d9dc0 for instance 5ba719a9-61df-4d8d-99c1-907f97a80e8e on hv-cinder-75996 Aug 13 04:33:57.614007 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-bd3beade-1786-4b4f-97bd-6c969c867ed6 req-d1b49210-3473-46b5-8103-c7d51dc2d83a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028556 Aug 13 04:33:57.614788 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 411/807] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:57 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:58.141871 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b585c3e2-2aa9-472c-bd44-dec168c84f83 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:58.143349 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b585c3e2-2aa9-472c-bd44-dec168c84f83 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:58.150318 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b585c3e2-2aa9-472c-bd44-dec168c84f83 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.151099 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b585c3e2-2aa9-472c-bd44-dec168c84f83 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.152233 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b585c3e2-2aa9-472c-bd44-dec168c84f83 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.152831 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b585c3e2-2aa9-472c-bd44-dec168c84f83 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.166340 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6a125e4e-3db1-4629-bfb9-30b419216675 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:58.167043 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6a125e4e-3db1-4629-bfb9-30b419216675 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:58.181145 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a125e4e-3db1-4629-bfb9-30b419216675 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.183098 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a125e4e-3db1-4629-bfb9-30b419216675 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.185305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a125e4e-3db1-4629-bfb9-30b419216675 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.186024 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a125e4e-3db1-4629-bfb9-30b419216675 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.503354 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b585c3e2-2aa9-472c-bd44-dec168c84f83 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:58.505279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6a125e4e-3db1-4629-bfb9-30b419216675 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:58.514518 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6a125e4e-3db1-4629-bfb9-30b419216675 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:58.516254 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b585c3e2-2aa9-472c-bd44-dec168c84f83 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1514 microversion: 2.1 time: 0.377937 Aug 13 04:33:58.516955 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 397/808] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:58 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:58.521640 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6a125e4e-3db1-4629-bfb9-30b419216675 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:58.525398 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6a125e4e-3db1-4629-bfb9-30b419216675 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1807 microversion: 2.20 time: 0.363188 Aug 13 04:33:58.526168 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 412/809] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:58 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1807 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:33:58.539697 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-54d20679-9ace-4f67-9fd8-d98fb0f9737e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:58.540532 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-54d20679-9ace-4f67-9fd8-d98fb0f9737e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:58.543987 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-fa8567b8-9f67-4053-8fc3-1e8643ba55cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:58.544981 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-fa8567b8-9f67-4053-8fc3-1e8643ba55cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:58.548886 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-54d20679-9ace-4f67-9fd8-d98fb0f9737e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.549379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-54d20679-9ace-4f67-9fd8-d98fb0f9737e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.549971 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-54d20679-9ace-4f67-9fd8-d98fb0f9737e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.552472 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-54d20679-9ace-4f67-9fd8-d98fb0f9737e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.559185 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fa8567b8-9f67-4053-8fc3-1e8643ba55cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.559647 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fa8567b8-9f67-4053-8fc3-1e8643ba55cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.560439 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fa8567b8-9f67-4053-8fc3-1e8643ba55cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.560879 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fa8567b8-9f67-4053-8fc3-1e8643ba55cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.891110 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-54d20679-9ace-4f67-9fd8-d98fb0f9737e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:58.903074 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-54d20679-9ace-4f67-9fd8-d98fb0f9737e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1548 microversion: 2.1 time: 0.375412 Aug 13 04:33:58.903952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 398/810] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:58 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1548 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:58.910174 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b0c2e11a-9e56-446f-9f47-7d63b8a40489 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:58.911037 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b0c2e11a-9e56-446f-9f47-7d63b8a40489 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:58.918844 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b0c2e11a-9e56-446f-9f47-7d63b8a40489 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.919549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b0c2e11a-9e56-446f-9f47-7d63b8a40489 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.920506 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b0c2e11a-9e56-446f-9f47-7d63b8a40489 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.921099 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b0c2e11a-9e56-446f-9f47-7d63b8a40489 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.938524 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-fa8567b8-9f67-4053-8fc3-1e8643ba55cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:58.951475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-fa8567b8-9f67-4053-8fc3-1e8643ba55cf tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1675 microversion: 2.1 time: 0.422603 Aug 13 04:33:58.953318 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 413/811] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:58 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1675 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:58.964462 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7477f022-ba10-4fbf-9282-054a054ebf95 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:58.970526 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7477f022-ba10-4fbf-9282-054a054ebf95 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:58.979796 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7477f022-ba10-4fbf-9282-054a054ebf95 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.985616 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7477f022-ba10-4fbf-9282-054a054ebf95 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:58.986679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7477f022-ba10-4fbf-9282-054a054ebf95 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:58.987137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7477f022-ba10-4fbf-9282-054a054ebf95 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.028875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-7477f022-ba10-4fbf-9282-054a054ebf95 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lazy-loading 'flavor' on Instance uuid 25395051-723e-4a2e-a22c-7892a0285098 {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:33:59.151321 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b0c2e11a-9e56-446f-9f47-7d63b8a40489 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:59.159707 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b0c2e11a-9e56-446f-9f47-7d63b8a40489 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.253455 Aug 13 04:33:59.160310 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 399/812] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:58 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:59.177942 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5030e344-d348-4fa7-911f-56c775436f4e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:59.179103 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5030e344-d348-4fa7-911f-56c775436f4e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:59.189595 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5030e344-d348-4fa7-911f-56c775436f4e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.190789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5030e344-d348-4fa7-911f-56c775436f4e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.195776 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5030e344-d348-4fa7-911f-56c775436f4e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.196255 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5030e344-d348-4fa7-911f-56c775436f4e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.201346 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7477f022-ba10-4fbf-9282-054a054ebf95 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/action" status: 200 len: 32 microversion: 2.1 time: 0.246640 Aug 13 04:33:59.204907 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 414/813] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:33:58 2021] POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/action => generated 32 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:33:59.218744 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6f709f84-70d3-46da-8eb4-4bd51e16135e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:59.220102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6f709f84-70d3-46da-8eb4-4bd51e16135e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:59.235661 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6f709f84-70d3-46da-8eb4-4bd51e16135e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.237223 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6f709f84-70d3-46da-8eb4-4bd51e16135e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.238468 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6f709f84-70d3-46da-8eb4-4bd51e16135e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.239078 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6f709f84-70d3-46da-8eb4-4bd51e16135e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.502249 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5030e344-d348-4fa7-911f-56c775436f4e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:59.511131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6f709f84-70d3-46da-8eb4-4bd51e16135e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:59.511943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5030e344-d348-4fa7-911f-56c775436f4e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1548 microversion: 2.1 time: 0.347402 Aug 13 04:33:59.514481 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 400/814] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:59 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1548 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:59.520791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6f709f84-70d3-46da-8eb4-4bd51e16135e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.312732 Aug 13 04:33:59.530877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-11a5fa6a-96d5-4587-9fe1-fd1143947b83 req-aab683cf-8f5e-482c-9aa2-29fdb5ae70fa service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eca45425-586a-4015-bea2-2e60a1aa42b3", "name": "network-vif-deleted", "tag": "cd209cdf-3517-46ae-b5d5-f413928df01c"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:59.530877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:59.530877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:33:59.531845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 415/815] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:59 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:59.537494 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:59.538367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:59.539412 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-11a5fa6a-96d5-4587-9fe1-fd1143947b83 req-aab683cf-8f5e-482c-9aa2-29fdb5ae70fa service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.541505 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-11a5fa6a-96d5-4587-9fe1-fd1143947b83 req-aab683cf-8f5e-482c-9aa2-29fdb5ae70fa service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.546619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.547344 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.548325 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.549024 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.553469 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-11a5fa6a-96d5-4587-9fe1-fd1143947b83 req-aab683cf-8f5e-482c-9aa2-29fdb5ae70fa service nova] Creating event network-vif-deleted:cd209cdf-3517-46ae-b5d5-f413928df01c for instance eca45425-586a-4015-bea2-2e60a1aa42b3 on hv-cinder-75996 Aug 13 04:33:59.558455 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-11a5fa6a-96d5-4587-9fe1-fd1143947b83 req-aab683cf-8f5e-482c-9aa2-29fdb5ae70fa service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042156 Aug 13 04:33:59.559712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 401/816] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:59.565036 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-cd58e242-e507-4004-9d63-2fa4d2433542 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:59.569515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:servers:allow_all_filters failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:59.569515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:33:59.570881 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-cd58e242-e507-4004-9d63-2fa4d2433542 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:59.571819 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-cd58e242-e507-4004-9d63-2fa4d2433542 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Searching by: {'deleted': False, 'project_id': 'c41ff29303444fd0820593792b37e277'} {{(pid=108288) get_all /opt/stack/nova/nova/compute/api.py:2833}} Aug 13 04:33:59.581953 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cd58e242-e507-4004-9d63-2fa4d2433542 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.582216 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cd58e242-e507-4004-9d63-2fa4d2433542 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.583206 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cd58e242-e507-4004-9d63-2fa4d2433542 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.583622 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.583741 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cd58e242-e507-4004-9d63-2fa4d2433542 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.584189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.584783 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lazy-loading 'fault' on Instance uuid eca45425-586a-4015-bea2-2e60a1aa42b3 {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:33:59.632442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:59.645865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6f852bb4-618a-426e-a01b-419ed7475d3e tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 200 len: 1308 microversion: 2.1 time: 0.112609 Aug 13 04:33:59.646711 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 416/817] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:59 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:33:59.652727 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c041e126-a114-481d-9a0f-98de83160be9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:59.653710 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c041e126-a114-481d-9a0f-98de83160be9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:59.662590 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c041e126-a114-481d-9a0f-98de83160be9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.663608 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c041e126-a114-481d-9a0f-98de83160be9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.664521 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c041e126-a114-481d-9a0f-98de83160be9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.665092 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c041e126-a114-481d-9a0f-98de83160be9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.691019 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.multi_cell_list [None req-cd58e242-e507-4004-9d63-2fa4d2433542 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=108288) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:371}} Aug 13 04:33:59.808800 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-cd58e242-e507-4004-9d63-2fa4d2433542 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.248129 Aug 13 04:33:59.809722 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 402/818] 10.222.0.13 () {58 vars in 1125 bytes} [Fri Aug 13 04:33:59 2021] GET /compute/v2.1/servers => generated 342 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:59.814345 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-f12f09eb-a2d5-4fdf-be0d-9d3f15da4f44 req-397e709f-75c0-4d84-8f97-f56fe2078875 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e0099a-7c38-4609-a63f-fee3baa6db7a", "name": "network-vif-plugged", "status": "completed", "tag": "a6019955-dfeb-42fd-bf68-d1fac8198ecb"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:33:59.816346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:33:59.816346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:33:59.820237 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c041e126-a114-481d-9a0f-98de83160be9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:59.824444 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-f12f09eb-a2d5-4fdf-be0d-9d3f15da4f44 req-397e709f-75c0-4d84-8f97-f56fe2078875 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.824884 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-f12f09eb-a2d5-4fdf-be0d-9d3f15da4f44 req-397e709f-75c0-4d84-8f97-f56fe2078875 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.829013 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c041e126-a114-481d-9a0f-98de83160be9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:59.830936 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c041e126-a114-481d-9a0f-98de83160be9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:33:59.832320 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c041e126-a114-481d-9a0f-98de83160be9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1794 microversion: 2.20 time: 0.184477 Aug 13 04:33:59.837627 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 417/819] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:33:59 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1794 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:33:59.840561 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-f12f09eb-a2d5-4fdf-be0d-9d3f15da4f44 req-397e709f-75c0-4d84-8f97-f56fe2078875 service nova] Creating event network-vif-plugged:a6019955-dfeb-42fd-bf68-d1fac8198ecb for instance 04e0099a-7c38-4609-a63f-fee3baa6db7a on hv-cinder-75996 Aug 13 04:33:59.842759 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5d4d360d-2f3e-4d7b-9a30-ece97fe76b23 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:59.843493 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5d4d360d-2f3e-4d7b-9a30-ece97fe76b23 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:59.845878 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-f12f09eb-a2d5-4fdf-be0d-9d3f15da4f44 req-397e709f-75c0-4d84-8f97-f56fe2078875 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035146 Aug 13 04:33:59.846720 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 403/820] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:33:59 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:33:59.853324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d4d360d-2f3e-4d7b-9a30-ece97fe76b23 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.854383 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d4d360d-2f3e-4d7b-9a30-ece97fe76b23 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.855243 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d4d360d-2f3e-4d7b-9a30-ece97fe76b23 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.856453 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5d4d360d-2f3e-4d7b-9a30-ece97fe76b23 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.970252 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f2d49a5a-a44b-45e9-bccb-f15d0412847a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:33:59.971391 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f2d49a5a-a44b-45e9-bccb-f15d0412847a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:33:59.977861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2d49a5a-a44b-45e9-bccb-f15d0412847a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.978301 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2d49a5a-a44b-45e9-bccb-f15d0412847a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.979350 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2d49a5a-a44b-45e9-bccb-f15d0412847a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:33:59.979571 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2d49a5a-a44b-45e9-bccb-f15d0412847a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:33:59.990814 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5d4d360d-2f3e-4d7b-9a30-ece97fe76b23 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:00.000644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5d4d360d-2f3e-4d7b-9a30-ece97fe76b23 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1548 microversion: 2.1 time: 0.166611 Aug 13 04:34:00.001580 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 418/821] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:59 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1548 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:00.126478 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f2d49a5a-a44b-45e9-bccb-f15d0412847a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:00.134403 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f2d49a5a-a44b-45e9-bccb-f15d0412847a tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1652 microversion: 2.1 time: 0.168278 Aug 13 04:34:00.147185 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 404/822] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:33:59 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1652 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:00.153148 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e4c18220-f83d-474a-bf39-cf986a9fa55f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:00.160496 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e4c18220-f83d-474a-bf39-cf986a9fa55f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:00.161020 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e4c18220-f83d-474a-bf39-cf986a9fa55f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:00.178811 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-dc2e221c-2ce7-45c6-82b1-baba0d77edc6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:00.179436 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-dc2e221c-2ce7-45c6-82b1-baba0d77edc6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:00.187896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dc2e221c-2ce7-45c6-82b1-baba0d77edc6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:00.188418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dc2e221c-2ce7-45c6-82b1-baba0d77edc6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:00.190217 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dc2e221c-2ce7-45c6-82b1-baba0d77edc6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:00.191742 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dc2e221c-2ce7-45c6-82b1-baba0d77edc6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:00.196094 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e4c18220-f83d-474a-bf39-cf986a9fa55f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Going to try to start instance {{(pid=108287) start /opt/stack/nova/nova/compute/api.py:2603}} Aug 13 04:34:00.247642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e4c18220-f83d-474a-bf39-cf986a9fa55f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action" status: 202 len: 0 microversion: 2.1 time: 0.097872 Aug 13 04:34:00.248836 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 419/823] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:34:00 2021] POST /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/action => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:34:00.259347 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-734ff7f5-7aba-4d5c-8c3e-41bb85d2d89b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:00.260506 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-734ff7f5-7aba-4d5c-8c3e-41bb85d2d89b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:00.269399 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-734ff7f5-7aba-4d5c-8c3e-41bb85d2d89b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:00.269923 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-734ff7f5-7aba-4d5c-8c3e-41bb85d2d89b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:00.271226 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-734ff7f5-7aba-4d5c-8c3e-41bb85d2d89b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:00.271358 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-734ff7f5-7aba-4d5c-8c3e-41bb85d2d89b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:00.425866 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-dc2e221c-2ce7-45c6-82b1-baba0d77edc6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:00.434512 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-dc2e221c-2ce7-45c6-82b1-baba0d77edc6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.261394 Aug 13 04:34:00.435749 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 405/824] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:00 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:00.469203 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-734ff7f5-7aba-4d5c-8c3e-41bb85d2d89b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:00.477369 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-734ff7f5-7aba-4d5c-8c3e-41bb85d2d89b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1661 microversion: 2.1 time: 0.223549 Aug 13 04:34:00.477986 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 420/825] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:00 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1661 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:00.537699 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e30c8986-afed-4397-ad01-d7b84a027d04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:00.538401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e30c8986-afed-4397-ad01-d7b84a027d04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:00.544222 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e30c8986-afed-4397-ad01-d7b84a027d04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:00.544970 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e30c8986-afed-4397-ad01-d7b84a027d04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:00.545808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e30c8986-afed-4397-ad01-d7b84a027d04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:00.546244 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e30c8986-afed-4397-ad01-d7b84a027d04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:00.662988 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b3be6cf9-f51a-47fd-a688-c0a8ec778d30 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:00.663603 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b3be6cf9-f51a-47fd-a688-c0a8ec778d30 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: eca45425-586a-4015-bea2-2e60a1aa42b3] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:00.672155 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3be6cf9-f51a-47fd-a688-c0a8ec778d30 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:00.672613 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3be6cf9-f51a-47fd-a688-c0a8ec778d30 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:00.673359 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e30c8986-afed-4397-ad01-d7b84a027d04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:00.673508 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3be6cf9-f51a-47fd-a688-c0a8ec778d30 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:00.673954 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3be6cf9-f51a-47fd-a688-c0a8ec778d30 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:00.682878 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e30c8986-afed-4397-ad01-d7b84a027d04 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.149109 Aug 13 04:34:00.683954 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 406/826] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:00 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:00.688129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-b3be6cf9-f51a-47fd-a688-c0a8ec778d30 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] HTTP exception thrown: Instance eca45425-586a-4015-bea2-2e60a1aa42b3 could not be found. Aug 13 04:34:00.688726 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b3be6cf9-f51a-47fd-a688-c0a8ec778d30 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Returning 404 to user: Instance eca45425-586a-4015-bea2-2e60a1aa42b3 could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:34:00.690373 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b3be6cf9-f51a-47fd-a688-c0a8ec778d30 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3" status: 404 len: 111 microversion: 2.1 time: 0.031457 Aug 13 04:34:00.691069 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 421/827] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:00 2021] GET /compute/v2.1/servers/eca45425-586a-4015-bea2-2e60a1aa42b3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 13 04:34:01.451613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e48a4d1f-af68-4f47-9b8e-e4ca2de4c6f5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:01.452276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e48a4d1f-af68-4f47-9b8e-e4ca2de4c6f5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:01.459499 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e48a4d1f-af68-4f47-9b8e-e4ca2de4c6f5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:01.459940 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e48a4d1f-af68-4f47-9b8e-e4ca2de4c6f5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:01.460707 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e48a4d1f-af68-4f47-9b8e-e4ca2de4c6f5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:01.461136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e48a4d1f-af68-4f47-9b8e-e4ca2de4c6f5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:01.494917 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-85bcbecf-8b1b-463b-a96e-ee760e9778a8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:01.495770 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-85bcbecf-8b1b-463b-a96e-ee760e9778a8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:01.507115 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85bcbecf-8b1b-463b-a96e-ee760e9778a8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:01.507604 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85bcbecf-8b1b-463b-a96e-ee760e9778a8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:01.508645 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85bcbecf-8b1b-463b-a96e-ee760e9778a8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:01.509113 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85bcbecf-8b1b-463b-a96e-ee760e9778a8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:01.626168 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e48a4d1f-af68-4f47-9b8e-e4ca2de4c6f5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:01.635565 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e48a4d1f-af68-4f47-9b8e-e4ca2de4c6f5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1266 microversion: 2.1 time: 0.187519 Aug 13 04:34:01.636503 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 407/828] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:01 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:01.641066 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-cee85319-4a39-4e00-833b-898b29dde986 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ab36ff70-1d66-4184-9462-6784af8592eb"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:01.642232 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-cee85319-4a39-4e00-833b-898b29dde986 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:01.653886 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cee85319-4a39-4e00-833b-898b29dde986 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:01.654136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cee85319-4a39-4e00-833b-898b29dde986 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:01.654949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cee85319-4a39-4e00-833b-898b29dde986 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:01.655391 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cee85319-4a39-4e00-833b-898b29dde986 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:01.683382 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-85bcbecf-8b1b-463b-a96e-ee760e9778a8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:01.691990 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-85bcbecf-8b1b-463b-a96e-ee760e9778a8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1661 microversion: 2.1 time: 0.200862 Aug 13 04:34:01.692556 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 422/829] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:01 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1661 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:01.704131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-60d17f5a-60ca-4e66-a3ce-d8ae74827a60 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:01.704994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-60d17f5a-60ca-4e66-a3ce-d8ae74827a60 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:01.712228 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-60d17f5a-60ca-4e66-a3ce-d8ae74827a60 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:01.712863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-60d17f5a-60ca-4e66-a3ce-d8ae74827a60 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:01.713839 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-60d17f5a-60ca-4e66-a3ce-d8ae74827a60 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:01.714582 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-60d17f5a-60ca-4e66-a3ce-d8ae74827a60 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:01.847765 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-60d17f5a-60ca-4e66-a3ce-d8ae74827a60 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:01.860055 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-60d17f5a-60ca-4e66-a3ce-d8ae74827a60 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.159128 Aug 13 04:34:01.862604 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 423/830] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:01 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:01.868981 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d20809a8-4de6-47b3-a3f6-b37ceb4cdcba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:01.869973 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d20809a8-4de6-47b3-a3f6-b37ceb4cdcba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:01.878780 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d20809a8-4de6-47b3-a3f6-b37ceb4cdcba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:01.879248 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d20809a8-4de6-47b3-a3f6-b37ceb4cdcba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:01.881158 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d20809a8-4de6-47b3-a3f6-b37ceb4cdcba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:01.881973 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d20809a8-4de6-47b3-a3f6-b37ceb4cdcba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:01.915137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d20809a8-4de6-47b3-a3f6-b37ceb4cdcba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:34:01.930920 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-cee85319-4a39-4e00-833b-898b29dde986 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "POST /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.293195 Aug 13 04:34:01.931646 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 408/831] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:34:01 2021] POST /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/os-volume_attachments => generated 194 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:34:02.007373 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d20809a8-4de6-47b3-a3f6-b37ceb4cdcba tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 204 len: 0 microversion: 2.1 time: 0.142838 Aug 13 04:34:02.008025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 424/832] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:34:01 2021] DELETE /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:34:02.016651 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3ed7c294-b88b-4238-8eb0-f5c7287e8365 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:02.017374 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3ed7c294-b88b-4238-8eb0-f5c7287e8365 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:02.024275 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3ed7c294-b88b-4238-8eb0-f5c7287e8365 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:02.024726 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3ed7c294-b88b-4238-8eb0-f5c7287e8365 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:02.025560 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3ed7c294-b88b-4238-8eb0-f5c7287e8365 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:02.026001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3ed7c294-b88b-4238-8eb0-f5c7287e8365 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:02.151239 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3ed7c294-b88b-4238-8eb0-f5c7287e8365 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:02.158821 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3ed7c294-b88b-4238-8eb0-f5c7287e8365 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1514 microversion: 2.1 time: 0.146547 Aug 13 04:34:02.159297 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 409/833] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:02 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1514 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:02.652724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-eb63c6b2-8313-4384-9ca5-db73558eac4d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:02.653443 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-eb63c6b2-8313-4384-9ca5-db73558eac4d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:02.659633 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb63c6b2-8313-4384-9ca5-db73558eac4d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:02.660078 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb63c6b2-8313-4384-9ca5-db73558eac4d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:02.660836 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb63c6b2-8313-4384-9ca5-db73558eac4d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:02.661261 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb63c6b2-8313-4384-9ca5-db73558eac4d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:02.709703 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-508b9e86-9cf6-4f2f-96a2-6f5da5498f56 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:02.710423 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-508b9e86-9cf6-4f2f-96a2-6f5da5498f56 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:02.716316 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-508b9e86-9cf6-4f2f-96a2-6f5da5498f56 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:02.716832 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-508b9e86-9cf6-4f2f-96a2-6f5da5498f56 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:02.717722 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-508b9e86-9cf6-4f2f-96a2-6f5da5498f56 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:02.718145 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-508b9e86-9cf6-4f2f-96a2-6f5da5498f56 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:02.816833 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-eb63c6b2-8313-4384-9ca5-db73558eac4d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:02.824702 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-eb63c6b2-8313-4384-9ca5-db73558eac4d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1453 microversion: 2.1 time: 0.176178 Aug 13 04:34:02.825484 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 425/834] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:02 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1453 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:02.840944 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e9af5b84-6f94-4419-9a4a-719cd1e97882 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:02.841599 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e9af5b84-6f94-4419-9a4a-719cd1e97882 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:02.848514 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e9af5b84-6f94-4419-9a4a-719cd1e97882 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:02.848996 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e9af5b84-6f94-4419-9a4a-719cd1e97882 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:02.849858 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e9af5b84-6f94-4419-9a4a-719cd1e97882 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:02.850309 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e9af5b84-6f94-4419-9a4a-719cd1e97882 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:02.872900 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-508b9e86-9cf6-4f2f-96a2-6f5da5498f56 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:02.881607 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-508b9e86-9cf6-4f2f-96a2-6f5da5498f56 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1665 microversion: 2.1 time: 0.176243 Aug 13 04:34:02.882174 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 410/835] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:02 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1665 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:02.886487 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-162d885d-1ecc-4698-a612-40426d40dbb1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:02.887229 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-162d885d-1ecc-4698-a612-40426d40dbb1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:02.894257 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-162d885d-1ecc-4698-a612-40426d40dbb1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:02.894708 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-162d885d-1ecc-4698-a612-40426d40dbb1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:02.895497 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-162d885d-1ecc-4698-a612-40426d40dbb1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:02.895933 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-162d885d-1ecc-4698-a612-40426d40dbb1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:03.004637 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e9af5b84-6f94-4419-9a4a-719cd1e97882 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:03.012615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e9af5b84-6f94-4419-9a4a-719cd1e97882 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1453 microversion: 2.1 time: 0.174815 Aug 13 04:34:03.013144 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 426/836] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:02 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1453 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:03.057989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-162d885d-1ecc-4698-a612-40426d40dbb1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:03.066657 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-162d885d-1ecc-4698-a612-40426d40dbb1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.183386 Aug 13 04:34:03.067240 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 411/837] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:02 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:03.175946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-887ca01e-042f-4b57-95a5-b9abb26bfa36 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:03.176803 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-887ca01e-042f-4b57-95a5-b9abb26bfa36 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:03.185260 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-887ca01e-042f-4b57-95a5-b9abb26bfa36 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:03.185749 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-887ca01e-042f-4b57-95a5-b9abb26bfa36 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:03.186533 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-887ca01e-042f-4b57-95a5-b9abb26bfa36 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:03.186977 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-887ca01e-042f-4b57-95a5-b9abb26bfa36 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:03.315466 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-887ca01e-042f-4b57-95a5-b9abb26bfa36 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:03.322888 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-887ca01e-042f-4b57-95a5-b9abb26bfa36 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1514 microversion: 2.1 time: 0.150544 Aug 13 04:34:03.323390 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 427/838] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:03 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1514 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:04.084585 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-de7926bd-a1ef-4999-8325-50e6a5e24e92 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:04.085364 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-de7926bd-a1ef-4999-8325-50e6a5e24e92 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:04.092462 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-de7926bd-a1ef-4999-8325-50e6a5e24e92 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:04.093155 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-de7926bd-a1ef-4999-8325-50e6a5e24e92 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:04.093989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-de7926bd-a1ef-4999-8325-50e6a5e24e92 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:04.094401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-de7926bd-a1ef-4999-8325-50e6a5e24e92 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:04.229949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-de7926bd-a1ef-4999-8325-50e6a5e24e92 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:04.238652 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-de7926bd-a1ef-4999-8325-50e6a5e24e92 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.158752 Aug 13 04:34:04.239331 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 412/839] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:04 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:04.340074 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d390a9b0-8362-4796-bd2b-d8170f505466 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:04.340691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d390a9b0-8362-4796-bd2b-d8170f505466 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:04.346831 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d390a9b0-8362-4796-bd2b-d8170f505466 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:04.347273 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d390a9b0-8362-4796-bd2b-d8170f505466 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:04.348046 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d390a9b0-8362-4796-bd2b-d8170f505466 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:04.348472 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d390a9b0-8362-4796-bd2b-d8170f505466 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:04.474440 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d390a9b0-8362-4796-bd2b-d8170f505466 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:04.482170 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d390a9b0-8362-4796-bd2b-d8170f505466 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1514 microversion: 2.1 time: 0.145670 Aug 13 04:34:04.482666 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 428/840] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:04 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1514 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:05.256147 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a7cbe993-4152-46d3-9e7f-100ca7108af8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:05.257377 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a7cbe993-4152-46d3-9e7f-100ca7108af8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:05.265487 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7cbe993-4152-46d3-9e7f-100ca7108af8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:05.265997 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7cbe993-4152-46d3-9e7f-100ca7108af8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:05.266955 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7cbe993-4152-46d3-9e7f-100ca7108af8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:05.269336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7cbe993-4152-46d3-9e7f-100ca7108af8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:05.375889 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-0847859f-babe-4861-bf0c-0ecf0f65dde6 req-07b3669b-4122-466a-8635-bc65ae3b4d21 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4efb80e9-e2d4-416d-ad9d-3957beb33d56", "name": "network-vif-deleted", "tag": "4a62d4b3-3837-414b-a01d-079fec907da0"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:05.379741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:34:05.379741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:34:05.388755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-0847859f-babe-4861-bf0c-0ecf0f65dde6 req-07b3669b-4122-466a-8635-bc65ae3b4d21 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:05.397126 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-0847859f-babe-4861-bf0c-0ecf0f65dde6 req-07b3669b-4122-466a-8635-bc65ae3b4d21 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:05.406006 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a7cbe993-4152-46d3-9e7f-100ca7108af8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:05.412953 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-0847859f-babe-4861-bf0c-0ecf0f65dde6 req-07b3669b-4122-466a-8635-bc65ae3b4d21 service nova] Creating event network-vif-deleted:4a62d4b3-3837-414b-a01d-079fec907da0 for instance 4efb80e9-e2d4-416d-ad9d-3957beb33d56 on hv-cinder-75996 Aug 13 04:34:05.414510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a7cbe993-4152-46d3-9e7f-100ca7108af8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.162628 Aug 13 04:34:05.415213 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 413/841] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:05 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:05.419979 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-0847859f-babe-4861-bf0c-0ecf0f65dde6 req-07b3669b-4122-466a-8635-bc65ae3b4d21 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048543 Aug 13 04:34:05.421058 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 429/842] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:34:05 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:34:05.499275 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:05.500755 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:05.510841 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:05.511587 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:05.512647 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:05.513286 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:05.550622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:05.551072 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:05.551520 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lazy-loading 'fault' on Instance uuid 4efb80e9-e2d4-416d-ad9d-3957beb33d56 {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:34:05.591448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1c6fcd7ffd124e7aa7ace34bed7f7423', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '44afcd45727640ec80dc17fe4fcf67fb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:05.599356 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-23a30722-0035-4c22-8f95-687daac0fd52 tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 200 len: 1308 microversion: 2.1 time: 0.104004 Aug 13 04:34:05.599921 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 414/843] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:05 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 1308 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:06.433302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9db72530-e211-4e1b-ad36-6856fa3eed8e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:06.434038 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9db72530-e211-4e1b-ad36-6856fa3eed8e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:06.441090 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9db72530-e211-4e1b-ad36-6856fa3eed8e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:06.441571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9db72530-e211-4e1b-ad36-6856fa3eed8e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:06.442351 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9db72530-e211-4e1b-ad36-6856fa3eed8e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:06.442788 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9db72530-e211-4e1b-ad36-6856fa3eed8e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:06.572011 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9db72530-e211-4e1b-ad36-6856fa3eed8e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:06.580577 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9db72530-e211-4e1b-ad36-6856fa3eed8e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.151200 Aug 13 04:34:06.581161 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 430/844] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:06 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:06.615781 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-29f50462-d40b-44f3-9262-fdea54da24fc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:06.616424 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-29f50462-d40b-44f3-9262-fdea54da24fc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] [instance: 4efb80e9-e2d4-416d-ad9d-3957beb33d56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:06.622338 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-29f50462-d40b-44f3-9262-fdea54da24fc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:06.622784 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-29f50462-d40b-44f3-9262-fdea54da24fc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:06.623550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-29f50462-d40b-44f3-9262-fdea54da24fc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:06.623979 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-29f50462-d40b-44f3-9262-fdea54da24fc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:06.637086 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-29f50462-d40b-44f3-9262-fdea54da24fc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] HTTP exception thrown: Instance 4efb80e9-e2d4-416d-ad9d-3957beb33d56 could not be found. Aug 13 04:34:06.637703 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-29f50462-d40b-44f3-9262-fdea54da24fc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] Returning 404 to user: Instance 4efb80e9-e2d4-416d-ad9d-3957beb33d56 could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:34:06.638528 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-29f50462-d40b-44f3-9262-fdea54da24fc tempest-AttachVolumeNegativeTest-1070642273 tempest-AttachVolumeNegativeTest-1070642273-project] 10.222.0.13 "GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56" status: 404 len: 111 microversion: 2.1 time: 0.026968 Aug 13 04:34:06.639062 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 415/845] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:06 2021] GET /compute/v2.1/servers/4efb80e9-e2d4-416d-ad9d-3957beb33d56 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:34:07.446321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-e5768fee-5773-4b68-91eb-828f5fa2dcfb req-c206b9c4-09b5-481f-a945-f02e74f5515a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "04e0099a-7c38-4609-a63f-fee3baa6db7a", "tag": "a6019955-dfeb-42fd-bf68-d1fac8198ecb"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:07.447824 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:34:07.447824 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:34:07.455627 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-e5768fee-5773-4b68-91eb-828f5fa2dcfb req-c206b9c4-09b5-481f-a945-f02e74f5515a service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:07.456110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-e5768fee-5773-4b68-91eb-828f5fa2dcfb req-c206b9c4-09b5-481f-a945-f02e74f5515a service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:07.471416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-e5768fee-5773-4b68-91eb-828f5fa2dcfb req-c206b9c4-09b5-481f-a945-f02e74f5515a service nova] Creating event network-changed:a6019955-dfeb-42fd-bf68-d1fac8198ecb for instance 04e0099a-7c38-4609-a63f-fee3baa6db7a on hv-cinder-75996 Aug 13 04:34:07.476082 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-e5768fee-5773-4b68-91eb-828f5fa2dcfb req-c206b9c4-09b5-481f-a945-f02e74f5515a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034466 Aug 13 04:34:07.476838 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 431/846] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:34:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:34:07.599222 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-aeeaeaca-fddf-42ee-a6ac-66351bdd9ab3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:07.599852 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-aeeaeaca-fddf-42ee-a6ac-66351bdd9ab3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:07.606325 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-aeeaeaca-fddf-42ee-a6ac-66351bdd9ab3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:07.606961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-aeeaeaca-fddf-42ee-a6ac-66351bdd9ab3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:07.608088 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-aeeaeaca-fddf-42ee-a6ac-66351bdd9ab3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:07.608586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-aeeaeaca-fddf-42ee-a6ac-66351bdd9ab3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:07.820781 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-aeeaeaca-fddf-42ee-a6ac-66351bdd9ab3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:07.828815 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-aeeaeaca-fddf-42ee-a6ac-66351bdd9ab3 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.234354 Aug 13 04:34:07.829527 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 416/847] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:07 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:08.849379 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-90486b9a-97db-4173-bda2-68748c3db94a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:08.850422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-90486b9a-97db-4173-bda2-68748c3db94a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:08.857696 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-90486b9a-97db-4173-bda2-68748c3db94a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:08.858139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-90486b9a-97db-4173-bda2-68748c3db94a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:08.859131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-90486b9a-97db-4173-bda2-68748c3db94a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:08.859562 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-90486b9a-97db-4173-bda2-68748c3db94a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:09.007762 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-90486b9a-97db-4173-bda2-68748c3db94a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:09.016453 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-90486b9a-97db-4173-bda2-68748c3db94a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.172628 Aug 13 04:34:09.017194 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 432/848] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:08 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:09.571537 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ff61c2a5-ee74-4796-bec8-606492b7c488 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:09.572145 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ff61c2a5-ee74-4796-bec8-606492b7c488 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:09.578503 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ff61c2a5-ee74-4796-bec8-606492b7c488 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:09.578947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ff61c2a5-ee74-4796-bec8-606492b7c488 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:09.579825 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ff61c2a5-ee74-4796-bec8-606492b7c488 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:09.581816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ff61c2a5-ee74-4796-bec8-606492b7c488 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:09.703554 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ff61c2a5-ee74-4796-bec8-606492b7c488 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:09.713032 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ff61c2a5-ee74-4796-bec8-606492b7c488 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1594 microversion: 2.1 time: 0.145015 Aug 13 04:34:09.713787 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 417/849] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:09 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1594 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:10.033301 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7cbc1d03-1e7a-4e6a-b057-22315b77c9d1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:10.033945 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7cbc1d03-1e7a-4e6a-b057-22315b77c9d1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:10.039741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7cbc1d03-1e7a-4e6a-b057-22315b77c9d1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:10.040307 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7cbc1d03-1e7a-4e6a-b057-22315b77c9d1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:10.041067 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7cbc1d03-1e7a-4e6a-b057-22315b77c9d1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:10.041524 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7cbc1d03-1e7a-4e6a-b057-22315b77c9d1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:10.166587 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7cbc1d03-1e7a-4e6a-b057-22315b77c9d1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:10.174871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7cbc1d03-1e7a-4e6a-b057-22315b77c9d1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.145104 Aug 13 04:34:10.175442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 433/850] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:10 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:11.193211 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fc43adbf-27cf-465d-9726-7b37081d63f9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:11.193841 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fc43adbf-27cf-465d-9726-7b37081d63f9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:11.199956 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fc43adbf-27cf-465d-9726-7b37081d63f9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:11.200708 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fc43adbf-27cf-465d-9726-7b37081d63f9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:11.201716 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fc43adbf-27cf-465d-9726-7b37081d63f9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:11.202403 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fc43adbf-27cf-465d-9726-7b37081d63f9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:11.342878 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-fc43adbf-27cf-465d-9726-7b37081d63f9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:11.356995 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fc43adbf-27cf-465d-9726-7b37081d63f9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.168166 Aug 13 04:34:11.357828 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 418/851] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:11 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:11.856517 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-2c8b2384-45cf-407d-9bcb-6bcd43bbb7ab req-68cac75d-5dc9-4274-98d5-f83a4df631ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da403df1-360d-41cf-86fd-0b09258785d0", "tag": "90912158-5071-4e18-b5b5-6e2227fd5493"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:11.859251 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:34:11.859251 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:34:11.868313 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-2c8b2384-45cf-407d-9bcb-6bcd43bbb7ab req-68cac75d-5dc9-4274-98d5-f83a4df631ef service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:11.869296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-2c8b2384-45cf-407d-9bcb-6bcd43bbb7ab req-68cac75d-5dc9-4274-98d5-f83a4df631ef service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:11.882699 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-2c8b2384-45cf-407d-9bcb-6bcd43bbb7ab req-68cac75d-5dc9-4274-98d5-f83a4df631ef service nova] Creating event network-changed:90912158-5071-4e18-b5b5-6e2227fd5493 for instance da403df1-360d-41cf-86fd-0b09258785d0 on hv-cinder-75996 Aug 13 04:34:11.888295 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-2c8b2384-45cf-407d-9bcb-6bcd43bbb7ab req-68cac75d-5dc9-4274-98d5-f83a4df631ef service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035505 Aug 13 04:34:11.890166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 434/852] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:34:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:34:12.375776 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fcedb245-524e-47eb-9409-16364b10966a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:12.377140 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fcedb245-524e-47eb-9409-16364b10966a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:12.394530 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fcedb245-524e-47eb-9409-16364b10966a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:12.395563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fcedb245-524e-47eb-9409-16364b10966a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:12.395786 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fcedb245-524e-47eb-9409-16364b10966a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:12.396221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fcedb245-524e-47eb-9409-16364b10966a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:12.881398 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-fcedb245-524e-47eb-9409-16364b10966a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:12.889550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fcedb245-524e-47eb-9409-16364b10966a tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.518184 Aug 13 04:34:12.898975 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 419/853] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:12 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:13.119687 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4ad197c0-8d04-4519-9f6f-46fc0dbf9508 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-2077988141"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:13.120360 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4ad197c0-8d04-4519-9f6f-46fc0dbf9508 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:13.126390 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4ad197c0-8d04-4519-9f6f-46fc0dbf9508 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:13.127429 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4ad197c0-8d04-4519-9f6f-46fc0dbf9508 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:13.128198 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4ad197c0-8d04-4519-9f6f-46fc0dbf9508 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:13.128626 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4ad197c0-8d04-4519-9f6f-46fc0dbf9508 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:13.246131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.network.security_group_api [None req-4ad197c0-8d04-4519-9f6f-46fc0dbf9508 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Adding security group c232f22c-735e-48a8-92bd-6c9155256075 to port 90912158-5071-4e18-b5b5-6e2227fd5493 Aug 13 04:34:13.616315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4ad197c0-8d04-4519-9f6f-46fc0dbf9508 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "POST /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/action" status: 202 len: 0 microversion: 2.1 time: 0.500637 Aug 13 04:34:13.616934 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 435/854] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:34:13 2021] POST /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/action => generated 0 bytes in 502 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:34:13.631430 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8ba764ea-2bb8-4502-8052-80b62ba28f01 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:13.632138 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8ba764ea-2bb8-4502-8052-80b62ba28f01 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:13.645840 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-f84a3c50-2756-475c-97e2-7f26dbeb76ef req-60c5b939-2cdd-4b2a-9edf-d31b234835db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da403df1-360d-41cf-86fd-0b09258785d0", "tag": "90912158-5071-4e18-b5b5-6e2227fd5493"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:13.648221 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:34:13.648221 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:34:13.657385 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-f84a3c50-2756-475c-97e2-7f26dbeb76ef req-60c5b939-2cdd-4b2a-9edf-d31b234835db service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:13.657718 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-f84a3c50-2756-475c-97e2-7f26dbeb76ef req-60c5b939-2cdd-4b2a-9edf-d31b234835db service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:13.659169 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8ba764ea-2bb8-4502-8052-80b62ba28f01 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:13.660891 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8ba764ea-2bb8-4502-8052-80b62ba28f01 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:13.663076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8ba764ea-2bb8-4502-8052-80b62ba28f01 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:13.664283 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8ba764ea-2bb8-4502-8052-80b62ba28f01 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:13.677115 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-f84a3c50-2756-475c-97e2-7f26dbeb76ef req-60c5b939-2cdd-4b2a-9edf-d31b234835db service nova] Creating event network-changed:90912158-5071-4e18-b5b5-6e2227fd5493 for instance da403df1-360d-41cf-86fd-0b09258785d0 on hv-cinder-75996 Aug 13 04:34:13.682578 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-f84a3c50-2756-475c-97e2-7f26dbeb76ef req-60c5b939-2cdd-4b2a-9edf-d31b234835db service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056172 Aug 13 04:34:13.684679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 436/855] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:34:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:34:13.910020 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-13c47b27-8dc4-40dd-bfdf-21293492563b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:13.911415 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-13c47b27-8dc4-40dd-bfdf-21293492563b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:13.920562 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13c47b27-8dc4-40dd-bfdf-21293492563b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:13.921393 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13c47b27-8dc4-40dd-bfdf-21293492563b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:13.922715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13c47b27-8dc4-40dd-bfdf-21293492563b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:13.923552 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13c47b27-8dc4-40dd-bfdf-21293492563b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:13.962084 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-8ba764ea-2bb8-4502-8052-80b62ba28f01 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:13.970323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8ba764ea-2bb8-4502-8052-80b62ba28f01 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1760 microversion: 2.1 time: 0.348862 Aug 13 04:34:13.971355 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 420/856] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:13 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1760 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:14.125248 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-13c47b27-8dc4-40dd-bfdf-21293492563b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:14.134414 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-13c47b27-8dc4-40dd-bfdf-21293492563b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.231371 Aug 13 04:34:14.135216 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 437/857] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:13 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:15.152398 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9d8e4764-1833-495c-a90a-bef46441ebf7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:15.153008 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9d8e4764-1833-495c-a90a-bef46441ebf7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:15.159411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d8e4764-1833-495c-a90a-bef46441ebf7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:15.159852 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d8e4764-1833-495c-a90a-bef46441ebf7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:15.160611 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d8e4764-1833-495c-a90a-bef46441ebf7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:15.161037 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d8e4764-1833-495c-a90a-bef46441ebf7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:15.300906 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9d8e4764-1833-495c-a90a-bef46441ebf7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:15.314468 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9d8e4764-1833-495c-a90a-bef46441ebf7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.165306 Aug 13 04:34:15.316157 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 421/858] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:15 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:16.335386 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9168cc37-6a59-4b3d-b259-96c00bf602b9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:16.336009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9168cc37-6a59-4b3d-b259-96c00bf602b9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:16.342030 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9168cc37-6a59-4b3d-b259-96c00bf602b9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:16.342475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9168cc37-6a59-4b3d-b259-96c00bf602b9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:16.343283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9168cc37-6a59-4b3d-b259-96c00bf602b9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:16.343725 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9168cc37-6a59-4b3d-b259-96c00bf602b9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:16.466333 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9168cc37-6a59-4b3d-b259-96c00bf602b9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:16.475191 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9168cc37-6a59-4b3d-b259-96c00bf602b9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.143545 Aug 13 04:34:16.475757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 438/859] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:16 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:17.492489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4d33f809-26c8-4611-8f21-01648f833c52 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:17.493105 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4d33f809-26c8-4611-8f21-01648f833c52 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:17.499026 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d33f809-26c8-4611-8f21-01648f833c52 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:17.499475 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d33f809-26c8-4611-8f21-01648f833c52 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:17.500246 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d33f809-26c8-4611-8f21-01648f833c52 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:17.500684 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4d33f809-26c8-4611-8f21-01648f833c52 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:17.621028 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4d33f809-26c8-4611-8f21-01648f833c52 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:17.632075 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4d33f809-26c8-4611-8f21-01648f833c52 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.142190 Aug 13 04:34:17.632075 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 422/860] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:17 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:18.648571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5e745830-9936-4905-8151-1848c3a37c69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:18.649195 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5e745830-9936-4905-8151-1848c3a37c69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:18.655092 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5e745830-9936-4905-8151-1848c3a37c69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:18.655545 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5e745830-9936-4905-8151-1848c3a37c69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:18.656308 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5e745830-9936-4905-8151-1848c3a37c69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:18.656747 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5e745830-9936-4905-8151-1848c3a37c69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:18.782189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5e745830-9936-4905-8151-1848c3a37c69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:18.790405 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5e745830-9936-4905-8151-1848c3a37c69 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.145775 Aug 13 04:34:18.790965 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 439/861] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:18 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:19.807822 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fde7f3f3-aba5-419c-8719-0cece88eb063 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:19.808517 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fde7f3f3-aba5-419c-8719-0cece88eb063 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:19.815215 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fde7f3f3-aba5-419c-8719-0cece88eb063 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:19.815663 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fde7f3f3-aba5-419c-8719-0cece88eb063 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:19.816430 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fde7f3f3-aba5-419c-8719-0cece88eb063 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:19.816859 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fde7f3f3-aba5-419c-8719-0cece88eb063 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:19.940277 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-fde7f3f3-aba5-419c-8719-0cece88eb063 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:19.948070 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fde7f3f3-aba5-419c-8719-0cece88eb063 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.143979 Aug 13 04:34:19.948640 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 423/862] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:19 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:20.965486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-33d0d7b3-6be9-43f1-966f-710319881008 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:20.966038 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-33d0d7b3-6be9-43f1-966f-710319881008 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:20.972478 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33d0d7b3-6be9-43f1-966f-710319881008 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:20.972919 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33d0d7b3-6be9-43f1-966f-710319881008 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:20.973710 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33d0d7b3-6be9-43f1-966f-710319881008 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:20.974146 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-33d0d7b3-6be9-43f1-966f-710319881008 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:21.096797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-33d0d7b3-6be9-43f1-966f-710319881008 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:21.104535 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-33d0d7b3-6be9-43f1-966f-710319881008 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.142896 Aug 13 04:34:21.105096 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 440/863] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:20 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:22.121610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-72ada592-f4fd-4ea2-a53b-31a00aa0812e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:22.122253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-72ada592-f4fd-4ea2-a53b-31a00aa0812e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:22.128899 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-72ada592-f4fd-4ea2-a53b-31a00aa0812e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:22.129350 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-72ada592-f4fd-4ea2-a53b-31a00aa0812e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:22.130171 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-72ada592-f4fd-4ea2-a53b-31a00aa0812e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:22.130609 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-72ada592-f4fd-4ea2-a53b-31a00aa0812e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:22.262313 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-72ada592-f4fd-4ea2-a53b-31a00aa0812e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:22.270468 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-72ada592-f4fd-4ea2-a53b-31a00aa0812e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.152613 Aug 13 04:34:22.271034 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 424/864] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:22 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:23.287190 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-dbf0bf3a-05be-4827-bb2c-f22692849f32 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:23.287810 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-dbf0bf3a-05be-4827-bb2c-f22692849f32 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:23.293766 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dbf0bf3a-05be-4827-bb2c-f22692849f32 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:23.294220 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dbf0bf3a-05be-4827-bb2c-f22692849f32 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:23.294997 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dbf0bf3a-05be-4827-bb2c-f22692849f32 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:23.295439 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dbf0bf3a-05be-4827-bb2c-f22692849f32 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:23.435059 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dbf0bf3a-05be-4827-bb2c-f22692849f32 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:23.446719 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dbf0bf3a-05be-4827-bb2c-f22692849f32 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.163119 Aug 13 04:34:23.447591 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 441/865] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:23 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:24.464010 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-6b8f793c-546e-4623-99c6-db05daf3cd6b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:24.464633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6b8f793c-546e-4623-99c6-db05daf3cd6b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:24.471402 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b8f793c-546e-4623-99c6-db05daf3cd6b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:24.471845 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b8f793c-546e-4623-99c6-db05daf3cd6b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:24.472613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b8f793c-546e-4623-99c6-db05daf3cd6b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:24.473040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6b8f793c-546e-4623-99c6-db05daf3cd6b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:24.599102 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-6b8f793c-546e-4623-99c6-db05daf3cd6b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:24.607091 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-6b8f793c-546e-4623-99c6-db05daf3cd6b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.146998 Aug 13 04:34:24.607663 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 425/866] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:24 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:25.627341 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5af4e317-6440-4c2b-ab55-f65bd38167c7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:25.629281 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5af4e317-6440-4c2b-ab55-f65bd38167c7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:25.637490 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5af4e317-6440-4c2b-ab55-f65bd38167c7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:25.638030 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5af4e317-6440-4c2b-ab55-f65bd38167c7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:25.639059 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5af4e317-6440-4c2b-ab55-f65bd38167c7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:25.639696 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5af4e317-6440-4c2b-ab55-f65bd38167c7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:25.775546 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5af4e317-6440-4c2b-ab55-f65bd38167c7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:25.784018 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5af4e317-6440-4c2b-ab55-f65bd38167c7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.163027 Aug 13 04:34:25.784597 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 442/867] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:25 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:26.801639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e7355930-580c-4506-ac58-e1f7bf14e77e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:26.802257 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e7355930-580c-4506-ac58-e1f7bf14e77e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:26.808828 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e7355930-580c-4506-ac58-e1f7bf14e77e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:26.809396 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e7355930-580c-4506-ac58-e1f7bf14e77e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:26.810311 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e7355930-580c-4506-ac58-e1f7bf14e77e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:26.810765 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e7355930-580c-4506-ac58-e1f7bf14e77e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:26.940671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e7355930-580c-4506-ac58-e1f7bf14e77e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:26.949502 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e7355930-580c-4506-ac58-e1f7bf14e77e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.152312 Aug 13 04:34:26.950081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 426/868] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:26 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:27.967404 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-844c59c9-cff5-4480-bf64-bc93c0159fe0 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:27.967951 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-844c59c9-cff5-4480-bf64-bc93c0159fe0 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:27.974888 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-844c59c9-cff5-4480-bf64-bc93c0159fe0 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:27.975339 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-844c59c9-cff5-4480-bf64-bc93c0159fe0 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:27.976107 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-844c59c9-cff5-4480-bf64-bc93c0159fe0 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:27.976544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-844c59c9-cff5-4480-bf64-bc93c0159fe0 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:28.099863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-844c59c9-cff5-4480-bf64-bc93c0159fe0 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:28.107636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-844c59c9-cff5-4480-bf64-bc93c0159fe0 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.144020 Aug 13 04:34:28.108207 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 443/869] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:27 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:29.123782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-736c96fb-e5d1-4a98-a912-60b24fe9e8c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:29.124391 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-736c96fb-e5d1-4a98-a912-60b24fe9e8c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:29.131282 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-736c96fb-e5d1-4a98-a912-60b24fe9e8c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:29.131732 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-736c96fb-e5d1-4a98-a912-60b24fe9e8c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:29.132527 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-736c96fb-e5d1-4a98-a912-60b24fe9e8c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:29.132964 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-736c96fb-e5d1-4a98-a912-60b24fe9e8c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:29.269914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-736c96fb-e5d1-4a98-a912-60b24fe9e8c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:29.278602 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-736c96fb-e5d1-4a98-a912-60b24fe9e8c5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.158343 Aug 13 04:34:29.285475 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 427/870] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:29 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:30.296078 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2eb22a26-b28d-480d-89d4-84cf78b413e6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:30.296838 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2eb22a26-b28d-480d-89d4-84cf78b413e6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:30.303788 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2eb22a26-b28d-480d-89d4-84cf78b413e6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:30.304237 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2eb22a26-b28d-480d-89d4-84cf78b413e6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:30.305011 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2eb22a26-b28d-480d-89d4-84cf78b413e6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:30.305467 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2eb22a26-b28d-480d-89d4-84cf78b413e6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:30.434693 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2eb22a26-b28d-480d-89d4-84cf78b413e6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:30.443113 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2eb22a26-b28d-480d-89d4-84cf78b413e6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.151171 Aug 13 04:34:30.443689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 444/871] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:30 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:31.460276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-61b9d1c4-2182-4c14-a143-0ffbef389f6e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:31.460996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-61b9d1c4-2182-4c14-a143-0ffbef389f6e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:31.467476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-61b9d1c4-2182-4c14-a143-0ffbef389f6e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:31.468053 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-61b9d1c4-2182-4c14-a143-0ffbef389f6e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:31.468894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-61b9d1c4-2182-4c14-a143-0ffbef389f6e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:31.469945 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-61b9d1c4-2182-4c14-a143-0ffbef389f6e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:31.593698 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-61b9d1c4-2182-4c14-a143-0ffbef389f6e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:31.602163 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-61b9d1c4-2182-4c14-a143-0ffbef389f6e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.146028 Aug 13 04:34:31.602732 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 428/872] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:31 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:32.618851 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2ff9eae7-9471-4b00-b2b5-48a538d079f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:32.619417 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2ff9eae7-9471-4b00-b2b5-48a538d079f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:32.625319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2ff9eae7-9471-4b00-b2b5-48a538d079f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:32.625847 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2ff9eae7-9471-4b00-b2b5-48a538d079f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:32.626630 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2ff9eae7-9471-4b00-b2b5-48a538d079f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:32.627071 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2ff9eae7-9471-4b00-b2b5-48a538d079f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:32.756023 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2ff9eae7-9471-4b00-b2b5-48a538d079f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:32.764415 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2ff9eae7-9471-4b00-b2b5-48a538d079f5 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1567 microversion: 2.1 time: 0.149215 Aug 13 04:34:32.765194 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 445/873] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:32 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:33.782710 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9d154def-9be0-4a68-a7ec-6ea5d99bf87e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:33.783313 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9d154def-9be0-4a68-a7ec-6ea5d99bf87e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:33.789657 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d154def-9be0-4a68-a7ec-6ea5d99bf87e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:33.790096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d154def-9be0-4a68-a7ec-6ea5d99bf87e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:33.790855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d154def-9be0-4a68-a7ec-6ea5d99bf87e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:33.791281 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d154def-9be0-4a68-a7ec-6ea5d99bf87e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:33.914477 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9d154def-9be0-4a68-a7ec-6ea5d99bf87e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:33.922175 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9d154def-9be0-4a68-a7ec-6ea5d99bf87e tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1547 microversion: 2.1 time: 0.143674 Aug 13 04:34:33.922962 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 429/874] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:33 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1547 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:33.939169 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5c76c8e2-1178-456a-a7ea-ab10703f9289 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:33.939670 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5c76c8e2-1178-456a-a7ea-ab10703f9289 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:33.945747 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5c76c8e2-1178-456a-a7ea-ab10703f9289 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:33.946198 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5c76c8e2-1178-456a-a7ea-ab10703f9289 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:33.946974 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5c76c8e2-1178-456a-a7ea-ab10703f9289 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:33.947417 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5c76c8e2-1178-456a-a7ea-ab10703f9289 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:34.031421 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-5c76c8e2-1178-456a-a7ea-ab10703f9289 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] HTTP exception thrown: Cannot 'detach_volume' instance 25395051-723e-4a2e-a22c-7892a0285098 while it is in vm_state rescued Aug 13 04:34:34.032271 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5c76c8e2-1178-456a-a7ea-ab10703f9289 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Returning 409 to user: Cannot 'detach_volume' instance 25395051-723e-4a2e-a22c-7892a0285098 while it is in vm_state rescued {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:34:34.033118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5c76c8e2-1178-456a-a7ea-ab10703f9289 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "DELETE /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments/92f369e5-1aab-4b2e-befa-5d5380ad6726" status: 409 len: 152 microversion: 2.1 time: 0.098284 Aug 13 04:34:34.033708 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 446/875] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:34:33 2021] DELETE /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments/92f369e5-1aab-4b2e-befa-5d5380ad6726 => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Aug 13 04:34:34.041960 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2e119d44-9eb5-4958-885e-4652e78aa4c1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:34.042524 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2e119d44-9eb5-4958-885e-4652e78aa4c1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:34.049268 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e119d44-9eb5-4958-885e-4652e78aa4c1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:34.049781 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e119d44-9eb5-4958-885e-4652e78aa4c1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:34.050571 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e119d44-9eb5-4958-885e-4652e78aa4c1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:34.051049 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e119d44-9eb5-4958-885e-4652e78aa4c1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:34.126835 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2e119d44-9eb5-4958-885e-4652e78aa4c1 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/action" status: 202 len: 0 microversion: 2.1 time: 0.087433 Aug 13 04:34:34.127618 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 430/876] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:34:34 2021] POST /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/action => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:34:34.135422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f7af7710-893b-4ab1-b9e7-f40c89ad16c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:34.136037 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f7af7710-893b-4ab1-b9e7-f40c89ad16c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:34.142315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f7af7710-893b-4ab1-b9e7-f40c89ad16c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:34.142828 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f7af7710-893b-4ab1-b9e7-f40c89ad16c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:34.143613 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f7af7710-893b-4ab1-b9e7-f40c89ad16c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:34.144222 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f7af7710-893b-4ab1-b9e7-f40c89ad16c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:34.358387 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f7af7710-893b-4ab1-b9e7-f40c89ad16c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:34.367238 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f7af7710-893b-4ab1-b9e7-f40c89ad16c9 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1555 microversion: 2.1 time: 0.235326 Aug 13 04:34:34.368112 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 447/877] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:34 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1555 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:35.385862 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-769e11da-4ecd-4117-87a2-ef58ae060044 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:35.386670 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-769e11da-4ecd-4117-87a2-ef58ae060044 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:35.393394 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-769e11da-4ecd-4117-87a2-ef58ae060044 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:35.393877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-769e11da-4ecd-4117-87a2-ef58ae060044 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:35.394650 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-769e11da-4ecd-4117-87a2-ef58ae060044 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:35.395088 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-769e11da-4ecd-4117-87a2-ef58ae060044 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:35.519637 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-769e11da-4ecd-4117-87a2-ef58ae060044 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:35.527416 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-769e11da-4ecd-4117-87a2-ef58ae060044 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1555 microversion: 2.1 time: 0.145602 Aug 13 04:34:35.527975 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 431/878] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:35 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1555 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:36.545414 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-42c49c09-ce37-4f62-9ccb-4981c0a0ce73 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:36.546173 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-42c49c09-ce37-4f62-9ccb-4981c0a0ce73 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:36.553073 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-42c49c09-ce37-4f62-9ccb-4981c0a0ce73 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:36.553699 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-42c49c09-ce37-4f62-9ccb-4981c0a0ce73 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:36.554334 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-42c49c09-ce37-4f62-9ccb-4981c0a0ce73 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:36.554809 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-42c49c09-ce37-4f62-9ccb-4981c0a0ce73 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:36.686139 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-42c49c09-ce37-4f62-9ccb-4981c0a0ce73 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:36.695551 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-42c49c09-ce37-4f62-9ccb-4981c0a0ce73 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1555 microversion: 2.1 time: 0.153782 Aug 13 04:34:36.696115 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 448/879] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:36 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:37.711807 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7c96255c-6bbb-44df-a86e-e957c5ea16d6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:37.712418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7c96255c-6bbb-44df-a86e-e957c5ea16d6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:37.718191 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c96255c-6bbb-44df-a86e-e957c5ea16d6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:37.718641 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c96255c-6bbb-44df-a86e-e957c5ea16d6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:37.719961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c96255c-6bbb-44df-a86e-e957c5ea16d6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:37.720399 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7c96255c-6bbb-44df-a86e-e957c5ea16d6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:37.871513 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7c96255c-6bbb-44df-a86e-e957c5ea16d6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:37.882148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7c96255c-6bbb-44df-a86e-e957c5ea16d6 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1561 microversion: 2.1 time: 0.173873 Aug 13 04:34:37.882722 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 432/880] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:37 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1561 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:37.958603 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-45cb10f0-1b80-4162-ae3a-decb5bdbc901 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:37.959231 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-45cb10f0-1b80-4162-ae3a-decb5bdbc901 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:37.965192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-45cb10f0-1b80-4162-ae3a-decb5bdbc901 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:37.965583 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-45cb10f0-1b80-4162-ae3a-decb5bdbc901 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:37.966354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-45cb10f0-1b80-4162-ae3a-decb5bdbc901 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:37.966790 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-45cb10f0-1b80-4162-ae3a-decb5bdbc901 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:38.051374 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-45cb10f0-1b80-4162-ae3a-decb5bdbc901 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lazy-loading 'services' on Instance uuid 25395051-723e-4a2e-a22c-7892a0285098 {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:34:38.119609 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-45cb10f0-1b80-4162-ae3a-decb5bdbc901 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "DELETE /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments/92f369e5-1aab-4b2e-befa-5d5380ad6726" status: 202 len: 0 microversion: 2.1 time: 0.164989 Aug 13 04:34:38.120273 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 449/881] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:34:37 2021] DELETE /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments/92f369e5-1aab-4b2e-befa-5d5380ad6726 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:34:38.129258 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-04401679-6ead-4289-80da-1c83afce0daf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:38.130326 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-04401679-6ead-4289-80da-1c83afce0daf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:38.137764 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-04401679-6ead-4289-80da-1c83afce0daf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:38.138307 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-04401679-6ead-4289-80da-1c83afce0daf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:38.139570 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-04401679-6ead-4289-80da-1c83afce0daf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:38.140076 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-04401679-6ead-4289-80da-1c83afce0daf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:38.184268 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-04401679-6ead-4289-80da-1c83afce0daf tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059378 Aug 13 04:34:38.184872 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 433/882] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:34:38 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:34:39.196795 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6a02d49a-81ec-472a-9732-6be5d47d9f10 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:39.197907 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6a02d49a-81ec-472a-9732-6be5d47d9f10 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:39.204547 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a02d49a-81ec-472a-9732-6be5d47d9f10 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:39.205009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a02d49a-81ec-472a-9732-6be5d47d9f10 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:39.205819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a02d49a-81ec-472a-9732-6be5d47d9f10 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:39.206258 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a02d49a-81ec-472a-9732-6be5d47d9f10 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:39.236150 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6a02d49a-81ec-472a-9732-6be5d47d9f10 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043452 Aug 13 04:34:39.236637 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 450/883] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:34:39 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:34:40.247651 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7f85f65e-426b-456c-b588-9f015ddbfe8b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:40.248493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7f85f65e-426b-456c-b588-9f015ddbfe8b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:40.254437 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7f85f65e-426b-456c-b588-9f015ddbfe8b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:40.254896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7f85f65e-426b-456c-b588-9f015ddbfe8b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:40.255667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7f85f65e-426b-456c-b588-9f015ddbfe8b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:40.256107 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7f85f65e-426b-456c-b588-9f015ddbfe8b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:40.287163 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7f85f65e-426b-456c-b588-9f015ddbfe8b tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043354 Aug 13 04:34:40.287717 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 434/884] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:34:40 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:34:42.624078 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-892adafb-ed21-436d-9415-eee6e2e42135 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:42.624585 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-892adafb-ed21-436d-9415-eee6e2e42135 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:42.630909 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-892adafb-ed21-436d-9415-eee6e2e42135 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:42.631356 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-892adafb-ed21-436d-9415-eee6e2e42135 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:42.632137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-892adafb-ed21-436d-9415-eee6e2e42135 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:42.632821 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-892adafb-ed21-436d-9415-eee6e2e42135 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:42.661409 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-892adafb-ed21-436d-9415-eee6e2e42135 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:34:42.744568 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-892adafb-ed21-436d-9415-eee6e2e42135 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 204 len: 0 microversion: 2.1 time: 0.124156 Aug 13 04:34:42.745162 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 451/885] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:34:42 2021] DELETE /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:34:42.755427 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5d1b8dea-bc41-415c-a4d9-749b36c05cc8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:42.756199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5d1b8dea-bc41-415c-a4d9-749b36c05cc8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:42.762936 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d1b8dea-bc41-415c-a4d9-749b36c05cc8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:42.763465 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d1b8dea-bc41-415c-a4d9-749b36c05cc8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:42.764309 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d1b8dea-bc41-415c-a4d9-749b36c05cc8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:42.764978 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5d1b8dea-bc41-415c-a4d9-749b36c05cc8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:42.910026 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5d1b8dea-bc41-415c-a4d9-749b36c05cc8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:42.917276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5d1b8dea-bc41-415c-a4d9-749b36c05cc8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1507 microversion: 2.1 time: 0.165928 Aug 13 04:34:42.918068 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 435/886] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:42 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1507 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:43.934684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b53531c1-63b5-471c-855f-2bac530f4b42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:43.935400 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b53531c1-63b5-471c-855f-2bac530f4b42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:43.942347 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b53531c1-63b5-471c-855f-2bac530f4b42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:43.942791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b53531c1-63b5-471c-855f-2bac530f4b42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:43.943554 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b53531c1-63b5-471c-855f-2bac530f4b42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:43.943990 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b53531c1-63b5-471c-855f-2bac530f4b42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:44.067479 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b53531c1-63b5-471c-855f-2bac530f4b42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:44.074858 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b53531c1-63b5-471c-855f-2bac530f4b42 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1507 microversion: 2.1 time: 0.144200 Aug 13 04:34:44.075433 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 452/887] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:43 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1507 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:45.091515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0e868acc-5c4d-487b-9e68-6d5db94ce303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:45.092153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0e868acc-5c4d-487b-9e68-6d5db94ce303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:45.098657 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0e868acc-5c4d-487b-9e68-6d5db94ce303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:45.099106 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0e868acc-5c4d-487b-9e68-6d5db94ce303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:45.099872 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0e868acc-5c4d-487b-9e68-6d5db94ce303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:45.100314 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0e868acc-5c4d-487b-9e68-6d5db94ce303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:45.226376 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-0e868acc-5c4d-487b-9e68-6d5db94ce303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:45.233727 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0e868acc-5c4d-487b-9e68-6d5db94ce303 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1507 microversion: 2.1 time: 0.145864 Aug 13 04:34:45.234844 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 436/888] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:45 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1507 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:46.256515 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e0fd27d3-f091-4aae-814a-622766e5de1f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:46.256515 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e0fd27d3-f091-4aae-814a-622766e5de1f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:46.260095 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e0fd27d3-f091-4aae-814a-622766e5de1f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:46.260688 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e0fd27d3-f091-4aae-814a-622766e5de1f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:46.261506 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e0fd27d3-f091-4aae-814a-622766e5de1f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:46.262314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e0fd27d3-f091-4aae-814a-622766e5de1f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:46.452606 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e0fd27d3-f091-4aae-814a-622766e5de1f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:46.461226 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e0fd27d3-f091-4aae-814a-622766e5de1f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 200 len: 1507 microversion: 2.1 time: 0.213318 Aug 13 04:34:46.461852 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 453/889] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:46 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 1507 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:46.555347 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-854a677e-6826-4a7e-99bf-3a7f6b120b26 req-e9ff0ec3-6dac-4112-895b-e13f022878c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9406e71a-2f8b-48ac-81a4-333ecc986171", "name": "network-vif-deleted", "tag": "a4b7cf28-b4f2-4d99-892d-76c8c11313cb"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:46.557071 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:34:46.557071 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:34:46.565693 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-854a677e-6826-4a7e-99bf-3a7f6b120b26 req-e9ff0ec3-6dac-4112-895b-e13f022878c2 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:46.566187 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-854a677e-6826-4a7e-99bf-3a7f6b120b26 req-e9ff0ec3-6dac-4112-895b-e13f022878c2 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:46.580628 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-854a677e-6826-4a7e-99bf-3a7f6b120b26 req-e9ff0ec3-6dac-4112-895b-e13f022878c2 service nova] Creating event network-vif-deleted:a4b7cf28-b4f2-4d99-892d-76c8c11313cb for instance 9406e71a-2f8b-48ac-81a4-333ecc986171 on hv-cinder-75996 Aug 13 04:34:46.585489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-854a677e-6826-4a7e-99bf-3a7f6b120b26 req-e9ff0ec3-6dac-4112-895b-e13f022878c2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034128 Aug 13 04:34:46.586128 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 437/890] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:34:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:34:47.477455 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4c0b64c8-df4c-4150-89ee-22294aa29c2f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:47.478102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4c0b64c8-df4c-4150-89ee-22294aa29c2f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 9406e71a-2f8b-48ac-81a4-333ecc986171] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:47.483894 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4c0b64c8-df4c-4150-89ee-22294aa29c2f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:47.485033 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4c0b64c8-df4c-4150-89ee-22294aa29c2f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:47.485975 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4c0b64c8-df4c-4150-89ee-22294aa29c2f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:47.486420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4c0b64c8-df4c-4150-89ee-22294aa29c2f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:47.499563 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-4c0b64c8-df4c-4150-89ee-22294aa29c2f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] HTTP exception thrown: Instance 9406e71a-2f8b-48ac-81a4-333ecc986171 could not be found. Aug 13 04:34:47.500834 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4c0b64c8-df4c-4150-89ee-22294aa29c2f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Returning 404 to user: Instance 9406e71a-2f8b-48ac-81a4-333ecc986171 could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:34:47.501686 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4c0b64c8-df4c-4150-89ee-22294aa29c2f tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171" status: 404 len: 111 microversion: 2.1 time: 0.027869 Aug 13 04:34:47.502231 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 454/891] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:47 2021] GET /compute/v2.1/servers/9406e71a-2f8b-48ac-81a4-333ecc986171 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:34:47.510711 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d52700a5-2224-420a-bfa1-cec589fe4cdd tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:47.511425 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d52700a5-2224-420a-bfa1-cec589fe4cdd tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:47.517851 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d52700a5-2224-420a-bfa1-cec589fe4cdd tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:47.518379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d52700a5-2224-420a-bfa1-cec589fe4cdd tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:47.519144 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d52700a5-2224-420a-bfa1-cec589fe4cdd tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:47.519577 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d52700a5-2224-420a-bfa1-cec589fe4cdd tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:47.545265 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d52700a5-2224-420a-bfa1-cec589fe4cdd tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Going to try to terminate instance {{(pid=108288) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:34:47.638786 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d52700a5-2224-420a-bfa1-cec589fe4cdd tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "DELETE /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 204 len: 0 microversion: 2.1 time: 0.125393 Aug 13 04:34:47.638786 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 438/892] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:34:47 2021] DELETE /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:34:47.646472 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3f45025b-7454-476e-b23d-be90282710a4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:47.648699 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3f45025b-7454-476e-b23d-be90282710a4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:47.657976 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f45025b-7454-476e-b23d-be90282710a4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:47.659257 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f45025b-7454-476e-b23d-be90282710a4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:47.660209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f45025b-7454-476e-b23d-be90282710a4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:47.660796 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f45025b-7454-476e-b23d-be90282710a4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:47.966845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3f45025b-7454-476e-b23d-be90282710a4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:47.974994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3f45025b-7454-476e-b23d-be90282710a4 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.338076 Aug 13 04:34:47.975581 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 455/893] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:47 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:48.993329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5839683b-49b4-4836-8f7e-8fd0c0bd2654 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:48.994060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5839683b-49b4-4836-8f7e-8fd0c0bd2654 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:48.999846 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5839683b-49b4-4836-8f7e-8fd0c0bd2654 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:49.000288 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5839683b-49b4-4836-8f7e-8fd0c0bd2654 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:49.001874 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5839683b-49b4-4836-8f7e-8fd0c0bd2654 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:49.002295 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5839683b-49b4-4836-8f7e-8fd0c0bd2654 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:49.174869 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5839683b-49b4-4836-8f7e-8fd0c0bd2654 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:49.182671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5839683b-49b4-4836-8f7e-8fd0c0bd2654 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.194224 Aug 13 04:34:49.183261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 439/894] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:48 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:50.200903 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0d3952a1-39ef-4c5a-9302-7cdc48a5cd56 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:50.201558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0d3952a1-39ef-4c5a-9302-7cdc48a5cd56 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:50.208043 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0d3952a1-39ef-4c5a-9302-7cdc48a5cd56 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:50.208490 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0d3952a1-39ef-4c5a-9302-7cdc48a5cd56 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:50.209261 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0d3952a1-39ef-4c5a-9302-7cdc48a5cd56 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:50.209729 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0d3952a1-39ef-4c5a-9302-7cdc48a5cd56 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:50.334511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0d3952a1-39ef-4c5a-9302-7cdc48a5cd56 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:50.342069 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0d3952a1-39ef-4c5a-9302-7cdc48a5cd56 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.144906 Aug 13 04:34:50.342631 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 456/895] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:50 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:51.359480 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4155d9b3-7739-4bff-b6a5-8d4295e8b718 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:51.360089 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4155d9b3-7739-4bff-b6a5-8d4295e8b718 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:51.365842 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4155d9b3-7739-4bff-b6a5-8d4295e8b718 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:51.366291 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4155d9b3-7739-4bff-b6a5-8d4295e8b718 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:51.367051 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4155d9b3-7739-4bff-b6a5-8d4295e8b718 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:51.367485 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4155d9b3-7739-4bff-b6a5-8d4295e8b718 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:51.491302 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4155d9b3-7739-4bff-b6a5-8d4295e8b718 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:51.498804 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4155d9b3-7739-4bff-b6a5-8d4295e8b718 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.143184 Aug 13 04:34:51.500150 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 440/896] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:51 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:52.515785 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-88809391-36f5-43e3-a394-c6acf2dcfbe7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:52.516402 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-88809391-36f5-43e3-a394-c6acf2dcfbe7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:52.522254 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88809391-36f5-43e3-a394-c6acf2dcfbe7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:52.522710 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88809391-36f5-43e3-a394-c6acf2dcfbe7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:52.523484 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88809391-36f5-43e3-a394-c6acf2dcfbe7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:52.523925 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88809391-36f5-43e3-a394-c6acf2dcfbe7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:52.676132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-88809391-36f5-43e3-a394-c6acf2dcfbe7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:52.683883 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-88809391-36f5-43e3-a394-c6acf2dcfbe7 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.171743 Aug 13 04:34:52.684646 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 457/897] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:52 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:53.701902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9d621ad0-afae-4cf6-892c-e7ed79427563 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:53.702515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9d621ad0-afae-4cf6-892c-e7ed79427563 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:53.708296 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d621ad0-afae-4cf6-892c-e7ed79427563 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:53.708745 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d621ad0-afae-4cf6-892c-e7ed79427563 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:53.709556 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d621ad0-afae-4cf6-892c-e7ed79427563 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:53.709997 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9d621ad0-afae-4cf6-892c-e7ed79427563 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:53.839884 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9d621ad0-afae-4cf6-892c-e7ed79427563 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:53.847673 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9d621ad0-afae-4cf6-892c-e7ed79427563 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.149345 Aug 13 04:34:53.848238 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 441/898] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:53 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:54.864023 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-859392b8-a5c6-438f-b99c-a85e4fb68086 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:54.864679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-859392b8-a5c6-438f-b99c-a85e4fb68086 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:54.870962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-859392b8-a5c6-438f-b99c-a85e4fb68086 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:54.871406 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-859392b8-a5c6-438f-b99c-a85e4fb68086 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:54.872234 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-859392b8-a5c6-438f-b99c-a85e4fb68086 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:54.872741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-859392b8-a5c6-438f-b99c-a85e4fb68086 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:55.079819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-859392b8-a5c6-438f-b99c-a85e4fb68086 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4b4e286001664c959d7a80966e8c1294', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'aae4e92976894be69e6eb06d4b7d2f3a', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:55.087555 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-859392b8-a5c6-438f-b99c-a85e4fb68086 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 200 len: 1521 microversion: 2.1 time: 0.227190 Aug 13 04:34:55.088136 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 458/899] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:54 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 1521 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:55.453676 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-455b290c-2621-475e-bcb5-d616812ad12a req-f2f3b417-4b72-41ae-991d-b3ab176e7e7b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25395051-723e-4a2e-a22c-7892a0285098", "name": "network-vif-deleted", "tag": "ec81d39e-63c0-4679-a7bd-2439e208e2db"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:55.455378 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:34:55.455378 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:34:55.462677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-455b290c-2621-475e-bcb5-d616812ad12a req-f2f3b417-4b72-41ae-991d-b3ab176e7e7b service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:55.463126 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-455b290c-2621-475e-bcb5-d616812ad12a req-f2f3b417-4b72-41ae-991d-b3ab176e7e7b service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:55.475504 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-455b290c-2621-475e-bcb5-d616812ad12a req-f2f3b417-4b72-41ae-991d-b3ab176e7e7b service nova] Creating event network-vif-deleted:ec81d39e-63c0-4679-a7bd-2439e208e2db for instance 25395051-723e-4a2e-a22c-7892a0285098 on hv-cinder-75996 Aug 13 04:34:55.480340 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-455b290c-2621-475e-bcb5-d616812ad12a req-f2f3b417-4b72-41ae-991d-b3ab176e7e7b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030946 Aug 13 04:34:55.480932 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 442/900] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:34:55 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:34:56.104805 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-85cf8fc3-cd46-46b2-b84a-3f54401ba5e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:56.105523 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-85cf8fc3-cd46-46b2-b84a-3f54401ba5e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] [instance: 25395051-723e-4a2e-a22c-7892a0285098] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:56.112011 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85cf8fc3-cd46-46b2-b84a-3f54401ba5e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:56.112499 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85cf8fc3-cd46-46b2-b84a-3f54401ba5e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:56.113329 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85cf8fc3-cd46-46b2-b84a-3f54401ba5e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:56.113825 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85cf8fc3-cd46-46b2-b84a-3f54401ba5e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:56.128157 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-85cf8fc3-cd46-46b2-b84a-3f54401ba5e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] HTTP exception thrown: Instance 25395051-723e-4a2e-a22c-7892a0285098 could not be found. Aug 13 04:34:56.128825 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-85cf8fc3-cd46-46b2-b84a-3f54401ba5e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] Returning 404 to user: Instance 25395051-723e-4a2e-a22c-7892a0285098 could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:34:56.129690 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-85cf8fc3-cd46-46b2-b84a-3f54401ba5e8 tempest-ServerRescueNegativeTestJSON-1616088586 tempest-ServerRescueNegativeTestJSON-1616088586-project] 10.222.0.13 "GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098" status: 404 len: 111 microversion: 2.1 time: 0.028871 Aug 13 04:34:56.130215 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 459/901] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:56 2021] GET /compute/v2.1/servers/25395051-723e-4a2e-a22c-7892a0285098 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:34:56.919890 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1bd4d477-d242-4734-9274-8aeaa718027b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:34:56.920986 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1bd4d477-d242-4734-9274-8aeaa718027b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:56.927641 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1bd4d477-d242-4734-9274-8aeaa718027b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:56.928086 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1bd4d477-d242-4734-9274-8aeaa718027b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:56.928843 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1bd4d477-d242-4734-9274-8aeaa718027b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:56.929380 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1bd4d477-d242-4734-9274-8aeaa718027b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:57.018208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1bd4d477-d242-4734-9274-8aeaa718027b tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "POST /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/action" status: 202 len: 0 microversion: 2.1 time: 0.101346 Aug 13 04:34:57.022950 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 443/902] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:34:56 2021] POST /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/action => generated 0 bytes in 108 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:34:57.028941 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-558de1d2-512f-4726-b71a-86d8073342b3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:57.029871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-558de1d2-512f-4726-b71a-86d8073342b3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:57.043761 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-558de1d2-512f-4726-b71a-86d8073342b3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:57.044234 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-558de1d2-512f-4726-b71a-86d8073342b3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:57.045396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-558de1d2-512f-4726-b71a-86d8073342b3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:57.045873 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-558de1d2-512f-4726-b71a-86d8073342b3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:57.391202 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-558de1d2-512f-4726-b71a-86d8073342b3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:57.399620 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-558de1d2-512f-4726-b71a-86d8073342b3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1752 microversion: 2.1 time: 0.375910 Aug 13 04:34:57.400268 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 460/903] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:57 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1752 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:34:58.419413 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e5fdf1c5-c3c2-4dab-8fc0-a4cde9b801d4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:58.420314 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e5fdf1c5-c3c2-4dab-8fc0-a4cde9b801d4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:58.428030 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5fdf1c5-c3c2-4dab-8fc0-a4cde9b801d4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:58.428482 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5fdf1c5-c3c2-4dab-8fc0-a4cde9b801d4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:58.429267 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5fdf1c5-c3c2-4dab-8fc0-a4cde9b801d4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:58.429734 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e5fdf1c5-c3c2-4dab-8fc0-a4cde9b801d4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:58.763870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e5fdf1c5-c3c2-4dab-8fc0-a4cde9b801d4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:58.781470 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e5fdf1c5-c3c2-4dab-8fc0-a4cde9b801d4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.362478 Aug 13 04:34:58.781470 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 444/904] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:58 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:58.848512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0fdba2a2-365c-430b-a140-26fc7329e572 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:58.850141 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0fdba2a2-365c-430b-a140-26fc7329e572 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:58.857101 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0fdba2a2-365c-430b-a140-26fc7329e572 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:58.857893 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0fdba2a2-365c-430b-a140-26fc7329e572 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:58.859819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0fdba2a2-365c-430b-a140-26fc7329e572 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:58.861025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0fdba2a2-365c-430b-a140-26fc7329e572 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:58.906994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0fdba2a2-365c-430b-a140-26fc7329e572 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.062199 Aug 13 04:34:58.908118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 461/905] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:34:58 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d/os-volume_attachments => generated 25 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:34:58.974017 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f01a48ae-7664-469b-a91d-fb383d9c07f7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:58.974821 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f01a48ae-7664-469b-a91d-fb383d9c07f7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:58.981160 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f01a48ae-7664-469b-a91d-fb383d9c07f7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:58.982048 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f01a48ae-7664-469b-a91d-fb383d9c07f7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:58.982998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f01a48ae-7664-469b-a91d-fb383d9c07f7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:58.983423 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f01a48ae-7664-469b-a91d-fb383d9c07f7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:59.026019 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f01a48ae-7664-469b-a91d-fb383d9c07f7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Going to try to terminate instance {{(pid=108288) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:34:59.136546 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f01a48ae-7664-469b-a91d-fb383d9c07f7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 204 len: 0 microversion: 2.1 time: 0.165163 Aug 13 04:34:59.138143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 445/906] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:34:58 2021] DELETE /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 0 bytes in 169 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:34:59.147751 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-6f64661a-7ee7-45c0-8124-bbf85e8f5542 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:59.149167 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6f64661a-7ee7-45c0-8124-bbf85e8f5542 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:59.156537 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6f64661a-7ee7-45c0-8124-bbf85e8f5542 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:59.157084 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6f64661a-7ee7-45c0-8124-bbf85e8f5542 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:59.158015 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6f64661a-7ee7-45c0-8124-bbf85e8f5542 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:59.158621 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6f64661a-7ee7-45c0-8124-bbf85e8f5542 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:59.357572 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a5c19300-0026-4945-b0a8-4915824ba907 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:59.358151 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a5c19300-0026-4945-b0a8-4915824ba907 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:59.368763 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a5c19300-0026-4945-b0a8-4915824ba907 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:59.370960 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-6f64661a-7ee7-45c0-8124-bbf85e8f5542 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:34:59.371591 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a5c19300-0026-4945-b0a8-4915824ba907 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:59.372508 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a5c19300-0026-4945-b0a8-4915824ba907 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:59.376243 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a5c19300-0026-4945-b0a8-4915824ba907 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:59.380619 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-6f64661a-7ee7-45c0-8124-bbf85e8f5542 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1671 microversion: 2.1 time: 0.236150 Aug 13 04:34:59.381378 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 446/907] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:59 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1671 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:34:59.420226 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a5c19300-0026-4945-b0a8-4915824ba907 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-volume_attachments/b9b7e8fb-6025-434d-9f37-33ff9dbde2fc" status: 200 len: 194 microversion: 2.20 time: 0.321843 Aug 13 04:34:59.421787 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 462/908] 10.222.0.13 () {60 vars in 1454 bytes} [Fri Aug 13 04:34:59 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-volume_attachments/b9b7e8fb-6025-434d-9f37-33ff9dbde2fc => generated 194 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:34:59.510193 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8b9eb163-561b-4b2d-90d9-6a9b7cc1ecce tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:59.511221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8b9eb163-561b-4b2d-90d9-6a9b7cc1ecce tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:59.518394 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8b9eb163-561b-4b2d-90d9-6a9b7cc1ecce tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:59.519106 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8b9eb163-561b-4b2d-90d9-6a9b7cc1ecce tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:59.520096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8b9eb163-561b-4b2d-90d9-6a9b7cc1ecce tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:59.521375 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8b9eb163-561b-4b2d-90d9-6a9b7cc1ecce tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:59.613635 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-8b9eb163-561b-4b2d-90d9-6a9b7cc1ecce tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lazy-loading 'services' on Instance uuid d299e5c1-cd60-4057-93a3-5d32e1908d2f {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:34:59.694684 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8b9eb163-561b-4b2d-90d9-6a9b7cc1ecce tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-volume_attachments/b9b7e8fb-6025-434d-9f37-33ff9dbde2fc" status: 202 len: 0 microversion: 2.20 time: 0.188157 Aug 13 04:34:59.695590 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 447/909] 10.222.0.13 () {60 vars in 1457 bytes} [Fri Aug 13 04:34:59 2021] DELETE /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-volume_attachments/b9b7e8fb-6025-434d-9f37-33ff9dbde2fc => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:34:59.704644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b3cb65df-bef6-46b7-a944-0eac7b99774b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:59.705749 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b3cb65df-bef6-46b7-a944-0eac7b99774b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:59.711835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3cb65df-bef6-46b7-a944-0eac7b99774b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:59.712394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3cb65df-bef6-46b7-a944-0eac7b99774b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:59.713292 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3cb65df-bef6-46b7-a944-0eac7b99774b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:59.713826 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b3cb65df-bef6-46b7-a944-0eac7b99774b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:59.744222 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b3cb65df-bef6-46b7-a944-0eac7b99774b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044262 Aug 13 04:34:59.744790 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 463/910] 10.222.0.13 () {60 vars in 1343 bytes} [Fri Aug 13 04:34:59 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:34:59.805722 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-18445f62-c9bb-4ef5-b6e7-1f03916d20f9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:34:59.805722 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-18445f62-c9bb-4ef5-b6e7-1f03916d20f9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:34:59.813718 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-18445f62-c9bb-4ef5-b6e7-1f03916d20f9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:59.817409 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-18445f62-c9bb-4ef5-b6e7-1f03916d20f9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:34:59.820870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-18445f62-c9bb-4ef5-b6e7-1f03916d20f9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:34:59.821449 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-18445f62-c9bb-4ef5-b6e7-1f03916d20f9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:00.089669 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-18445f62-c9bb-4ef5-b6e7-1f03916d20f9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:00.099007 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-18445f62-c9bb-4ef5-b6e7-1f03916d20f9 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.305990 Aug 13 04:35:00.099579 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 448/911] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:34:59 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:00.398543 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-693d3161-6717-442a-8047-9daa9e3847da tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:00.400102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-693d3161-6717-442a-8047-9daa9e3847da tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:00.407973 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-693d3161-6717-442a-8047-9daa9e3847da tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:00.408574 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-693d3161-6717-442a-8047-9daa9e3847da tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:00.409526 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-693d3161-6717-442a-8047-9daa9e3847da tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:00.410648 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-693d3161-6717-442a-8047-9daa9e3847da tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:00.568665 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-693d3161-6717-442a-8047-9daa9e3847da tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:00.576571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-693d3161-6717-442a-8047-9daa9e3847da tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1671 microversion: 2.1 time: 0.182065 Aug 13 04:35:00.577134 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 464/912] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:00 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1671 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:00.759090 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f564fda1-e64e-4917-9c7b-1307e825c789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:00.759090 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f564fda1-e64e-4917-9c7b-1307e825c789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:00.769356 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f564fda1-e64e-4917-9c7b-1307e825c789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:00.769827 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f564fda1-e64e-4917-9c7b-1307e825c789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:00.770700 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f564fda1-e64e-4917-9c7b-1307e825c789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:00.771312 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f564fda1-e64e-4917-9c7b-1307e825c789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:00.802174 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f564fda1-e64e-4917-9c7b-1307e825c789 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048944 Aug 13 04:35:00.803330 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 449/913] 10.222.0.13 () {60 vars in 1343 bytes} [Fri Aug 13 04:35:00 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:00.872519 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-39d7bd64-c86a-458c-add3-92b19daa170c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:00.873009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-39d7bd64-c86a-458c-add3-92b19daa170c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:00.880762 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-39d7bd64-c86a-458c-add3-92b19daa170c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:00.880762 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-39d7bd64-c86a-458c-add3-92b19daa170c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:00.880762 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-39d7bd64-c86a-458c-add3-92b19daa170c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:00.881140 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-39d7bd64-c86a-458c-add3-92b19daa170c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:00.906367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-39d7bd64-c86a-458c-add3-92b19daa170c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:35:01.001826 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-39d7bd64-c86a-458c-add3-92b19daa170c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 204 len: 0 microversion: 2.20 time: 0.132890 Aug 13 04:35:01.002520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 465/914] 10.222.0.13 () {60 vars in 1280 bytes} [Fri Aug 13 04:35:00 2021] DELETE /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 13 04:35:01.010708 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2f123561-f988-4803-8b83-426c67edbf8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:01.011460 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2f123561-f988-4803-8b83-426c67edbf8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:01.018524 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2f123561-f988-4803-8b83-426c67edbf8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:01.018967 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2f123561-f988-4803-8b83-426c67edbf8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:01.019739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2f123561-f988-4803-8b83-426c67edbf8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:01.020226 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2f123561-f988-4803-8b83-426c67edbf8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:01.116999 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-88fa811b-bede-493a-a9e0-79c18d370238 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:01.117913 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-88fa811b-bede-493a-a9e0-79c18d370238 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:01.124911 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88fa811b-bede-493a-a9e0-79c18d370238 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:01.125528 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88fa811b-bede-493a-a9e0-79c18d370238 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:01.126418 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88fa811b-bede-493a-a9e0-79c18d370238 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:01.127068 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88fa811b-bede-493a-a9e0-79c18d370238 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:01.154876 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2f123561-f988-4803-8b83-426c67edbf8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:01.163830 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2f123561-f988-4803-8b83-426c67edbf8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:01.165654 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2f123561-f988-4803-8b83-426c67edbf8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:01.166931 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2f123561-f988-4803-8b83-426c67edbf8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.160008 Aug 13 04:35:01.167712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 450/915] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:01 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:01.259562 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-88fa811b-bede-493a-a9e0-79c18d370238 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:01.268897 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-88fa811b-bede-493a-a9e0-79c18d370238 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.155856 Aug 13 04:35:01.269502 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 466/916] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:01 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:01.597041 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-64f63962-e507-4fc7-a6c1-22e4109cad88 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:01.597764 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-64f63962-e507-4fc7-a6c1-22e4109cad88 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:01.603517 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-64f63962-e507-4fc7-a6c1-22e4109cad88 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:01.603954 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-64f63962-e507-4fc7-a6c1-22e4109cad88 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:01.604710 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-64f63962-e507-4fc7-a6c1-22e4109cad88 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:01.605143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-64f63962-e507-4fc7-a6c1-22e4109cad88 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:01.729770 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-64f63962-e507-4fc7-a6c1-22e4109cad88 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:01.737410 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-64f63962-e507-4fc7-a6c1-22e4109cad88 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1671 microversion: 2.1 time: 0.144707 Aug 13 04:35:01.737998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 451/917] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:01 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1671 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:02.186482 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9605ffb6-8871-4642-91c9-265977357ad1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:02.187596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9605ffb6-8871-4642-91c9-265977357ad1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:02.194492 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9605ffb6-8871-4642-91c9-265977357ad1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:02.195286 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9605ffb6-8871-4642-91c9-265977357ad1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:02.196262 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9605ffb6-8871-4642-91c9-265977357ad1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:02.196787 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9605ffb6-8871-4642-91c9-265977357ad1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:02.286768 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-49a856ac-c7e4-4b64-8e67-4d9aae88a381 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:02.287409 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-49a856ac-c7e4-4b64-8e67-4d9aae88a381 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:02.294455 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-49a856ac-c7e4-4b64-8e67-4d9aae88a381 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:02.294916 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-49a856ac-c7e4-4b64-8e67-4d9aae88a381 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:02.295704 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-49a856ac-c7e4-4b64-8e67-4d9aae88a381 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:02.297208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-49a856ac-c7e4-4b64-8e67-4d9aae88a381 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:02.473516 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9605ffb6-8871-4642-91c9-265977357ad1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:02.482331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9605ffb6-8871-4642-91c9-265977357ad1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:02.484055 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9605ffb6-8871-4642-91c9-265977357ad1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:02.485387 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9605ffb6-8871-4642-91c9-265977357ad1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.303061 Aug 13 04:35:02.485961 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 467/918] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:02 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:02.568482 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-49a856ac-c7e4-4b64-8e67-4d9aae88a381 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:02.578810 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-49a856ac-c7e4-4b64-8e67-4d9aae88a381 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.295967 Aug 13 04:35:02.579393 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 452/919] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:02 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:35:02.755662 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-627a5839-0262-44be-a146-c418d4f87ba3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:02.756479 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-627a5839-0262-44be-a146-c418d4f87ba3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:02.762511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-627a5839-0262-44be-a146-c418d4f87ba3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:02.763046 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-627a5839-0262-44be-a146-c418d4f87ba3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:02.763911 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-627a5839-0262-44be-a146-c418d4f87ba3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:02.764418 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-627a5839-0262-44be-a146-c418d4f87ba3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:02.836621 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-627a5839-0262-44be-a146-c418d4f87ba3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:02.844583 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-627a5839-0262-44be-a146-c418d4f87ba3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 200 len: 1603 microversion: 2.1 time: 0.092610 Aug 13 04:35:02.845160 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 468/920] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:02 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 1603 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:02.944763 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-9ea545d4-dca8-432e-b975-828c146b5875 req-dc2ac26f-9a99-473d-8b25-eccf459b26d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a0662f42-e77d-4f85-84ad-b58befdc445d", "name": "network-vif-deleted", "tag": "f5bada29-7024-47b0-b3dd-d142dd41cdda"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:02.946755 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:35:02.946755 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:35:02.966816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-9ea545d4-dca8-432e-b975-828c146b5875 req-dc2ac26f-9a99-473d-8b25-eccf459b26d9 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:02.967253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-9ea545d4-dca8-432e-b975-828c146b5875 req-dc2ac26f-9a99-473d-8b25-eccf459b26d9 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:02.984668 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-9ea545d4-dca8-432e-b975-828c146b5875 req-dc2ac26f-9a99-473d-8b25-eccf459b26d9 service nova] Creating event network-vif-deleted:f5bada29-7024-47b0-b3dd-d142dd41cdda for instance a0662f42-e77d-4f85-84ad-b58befdc445d on hv-cinder-75996 Aug 13 04:35:02.991221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-9ea545d4-dca8-432e-b975-828c146b5875 req-dc2ac26f-9a99-473d-8b25-eccf459b26d9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049988 Aug 13 04:35:02.992419 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 453/921] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:35:02 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:35:03.507711 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-25c90f80-081c-4aef-8986-309721e253cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:03.508482 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-25c90f80-081c-4aef-8986-309721e253cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:03.523350 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-25c90f80-081c-4aef-8986-309721e253cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:03.524907 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-25c90f80-081c-4aef-8986-309721e253cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:03.527064 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-25c90f80-081c-4aef-8986-309721e253cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:03.528119 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-25c90f80-081c-4aef-8986-309721e253cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:03.597126 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-912ee0bb-a582-426f-b422-65562bfcd2a3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:03.598115 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-912ee0bb-a582-426f-b422-65562bfcd2a3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:03.606312 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-912ee0bb-a582-426f-b422-65562bfcd2a3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:03.617779 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-912ee0bb-a582-426f-b422-65562bfcd2a3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:03.618897 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-912ee0bb-a582-426f-b422-65562bfcd2a3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:03.619431 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-912ee0bb-a582-426f-b422-65562bfcd2a3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:03.775734 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-25c90f80-081c-4aef-8986-309721e253cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:03.785546 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-25c90f80-081c-4aef-8986-309721e253cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:03.787060 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-25c90f80-081c-4aef-8986-309721e253cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:03.788217 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-25c90f80-081c-4aef-8986-309721e253cc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1722 microversion: 2.20 time: 0.288132 Aug 13 04:35:03.788865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 469/922] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:03 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1722 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:03.862839 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3ce8d9b7-2fbc-4e4f-a700-885683497212 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:03.863472 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3ce8d9b7-2fbc-4e4f-a700-885683497212 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:03.875493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-912ee0bb-a582-426f-b422-65562bfcd2a3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:03.884308 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-912ee0bb-a582-426f-b422-65562bfcd2a3 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.291920 Aug 13 04:35:03.884902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 454/923] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:03 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:35:03.885890 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9b7-2fbc-4e4f-a700-885683497212 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:03.886479 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9b7-2fbc-4e4f-a700-885683497212 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:03.887323 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9b7-2fbc-4e4f-a700-885683497212 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:03.891426 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3ce8d9b7-2fbc-4e4f-a700-885683497212 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:03.913895 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-3ce8d9b7-2fbc-4e4f-a700-885683497212 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] HTTP exception thrown: Instance a0662f42-e77d-4f85-84ad-b58befdc445d could not be found. Aug 13 04:35:03.920268 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3ce8d9b7-2fbc-4e4f-a700-885683497212 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Returning 404 to user: Instance a0662f42-e77d-4f85-84ad-b58befdc445d could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:35:03.924350 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3ce8d9b7-2fbc-4e4f-a700-885683497212 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 404 len: 111 microversion: 2.1 time: 0.063167 Aug 13 04:35:03.926358 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 470/924] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:03 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 13 04:35:03.935634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9a711512-0922-47b2-b3cc-b3149357cbf1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '.version_select at 0x7fc46c8df5e0>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:04.033028 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9a711512-0922-47b2-b3cc-b3149357cbf1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-187959874" status: 202 len: 0 microversion: 2.1 time: 0.102591 Aug 13 04:35:04.033818 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 455/925] 10.222.0.13 () {58 vars in 1218 bytes} [Fri Aug 13 04:35:03 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-187959874 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:04.187447 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-dedaaf75-f8e3-4857-bfd3-37025b3c1ab1 req-898d2b47-0c3e-45f1-b859-430332b9b679 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d299e5c1-cd60-4057-93a3-5d32e1908d2f", "name": "network-vif-deleted", "tag": "c3be48be-e5ee-48ea-a418-bc6c5c7a337c"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:04.203389 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:35:04.203389 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:35:04.247063 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-dedaaf75-f8e3-4857-bfd3-37025b3c1ab1 req-898d2b47-0c3e-45f1-b859-430332b9b679 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:04.249845 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-dedaaf75-f8e3-4857-bfd3-37025b3c1ab1 req-898d2b47-0c3e-45f1-b859-430332b9b679 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:04.291864 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-dedaaf75-f8e3-4857-bfd3-37025b3c1ab1 req-898d2b47-0c3e-45f1-b859-430332b9b679 service nova] Creating event network-vif-deleted:c3be48be-e5ee-48ea-a418-bc6c5c7a337c for instance d299e5c1-cd60-4057-93a3-5d32e1908d2f on hv-cinder-75996 Aug 13 04:35:04.316933 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-dedaaf75-f8e3-4857-bfd3-37025b3c1ab1 req-898d2b47-0c3e-45f1-b859-430332b9b679 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.144581 Aug 13 04:35:04.321976 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 471/926] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:35:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:35:04.807196 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:04.807807 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:04.821996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:04.822699 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:04.824360 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:04.826281 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:04.907599 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-cfe73d85-2cba-4b20-a08b-a75a0f9644cd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:04.908992 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-cfe73d85-2cba-4b20-a08b-a75a0f9644cd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:04.946459 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cfe73d85-2cba-4b20-a08b-a75a0f9644cd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:04.947846 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cfe73d85-2cba-4b20-a08b-a75a0f9644cd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:04.949728 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cfe73d85-2cba-4b20-a08b-a75a0f9644cd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:04.950844 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cfe73d85-2cba-4b20-a08b-a75a0f9644cd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:04.989228 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:04.990326 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:04.991411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lazy-loading 'fault' on Instance uuid d299e5c1-cd60-4057-93a3-5d32e1908d2f {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:35:05.160274 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:05.171644 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:05.176922 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:05.182717 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0c414c54-676e-40a9-8caf-7304daaf0c1f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 200 len: 1372 microversion: 2.20 time: 0.379448 Aug 13 04:35:05.185747 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 456/927] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:04 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 1372 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:35:05.255150 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9fd567fd-a099-4ef2-b1a3-9680015cc4c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'create', calling method: .version_select at 0x7fc46c615670>, body: {"keypair": {"name": "tempest-keypair-1193055186"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:05.274646 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-cfe73d85-2cba-4b20-a08b-a75a0f9644cd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:05.283069 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-cfe73d85-2cba-4b20-a08b-a75a0f9644cd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.383540 Aug 13 04:35:05.283502 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 472/928] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:04 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:35:05.331519 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-9fd567fd-a099-4ef2-b1a3-9680015cc4c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for project 14887014218041cc86fddfa8a151dcd6. Resources: {'key_pairs'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:35:05.335986 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-9fd567fd-a099-4ef2-b1a3-9680015cc4c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for user 45e5e56984454deb8f490bbf5a0f1435 and project 14887014218041cc86fddfa8a151dcd6. Resources: {'key_pairs'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:35:05.433202 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-9fd567fd-a099-4ef2-b1a3-9680015cc4c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for project 14887014218041cc86fddfa8a151dcd6. Resources: {'key_pairs'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:35:05.438815 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-9fd567fd-a099-4ef2-b1a3-9680015cc4c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for user 45e5e56984454deb8f490bbf5a0f1435 and project 14887014218041cc86fddfa8a151dcd6. Resources: {'key_pairs'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:35:05.459810 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9fd567fd-a099-4ef2-b1a3-9680015cc4c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.213787 Aug 13 04:35:05.465229 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 457/929] 10.222.0.13 () {60 vars in 1158 bytes} [Fri Aug 13 04:35:05 2021] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:35:06.235332 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4783449b-a64b-486c-a606-266256b24923 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:06.235874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4783449b-a64b-486c-a606-266256b24923 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:06.241835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4783449b-a64b-486c-a606-266256b24923 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:06.242311 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4783449b-a64b-486c-a606-266256b24923 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:06.243073 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4783449b-a64b-486c-a606-266256b24923 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:06.243511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4783449b-a64b-486c-a606-266256b24923 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:06.258195 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-4783449b-a64b-486c-a606-266256b24923 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] HTTP exception thrown: Instance d299e5c1-cd60-4057-93a3-5d32e1908d2f could not be found. Aug 13 04:35:06.258792 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4783449b-a64b-486c-a606-266256b24923 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Returning 404 to user: Instance d299e5c1-cd60-4057-93a3-5d32e1908d2f could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:35:06.259628 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4783449b-a64b-486c-a606-266256b24923 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 404 len: 111 microversion: 2.20 time: 0.028874 Aug 13 04:35:06.260267 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 473/930] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:06 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 13 04:35:06.270650 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fa58774c-6bc4-46ee-a5c8-365f61f7610a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '.version_select at 0x7fc46c665ee0>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:06.288613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fa58774c-6bc4-46ee-a5c8-365f61f7610a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951400845" status: 204 len: 0 microversion: 2.20 time: 0.023248 Aug 13 04:35:06.289190 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 458/931] 10.222.0.13 () {60 vars in 1262 bytes} [Fri Aug 13 04:35:06 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1951400845 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 13 04:35:06.300586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a884e971-426d-4735-a98c-3e17d07d791d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:06.301513 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a884e971-426d-4735-a98c-3e17d07d791d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:06.308249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a884e971-426d-4735-a98c-3e17d07d791d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:06.308741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a884e971-426d-4735-a98c-3e17d07d791d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:06.309572 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a884e971-426d-4735-a98c-3e17d07d791d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:06.310033 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a884e971-426d-4735-a98c-3e17d07d791d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:06.558548 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a884e971-426d-4735-a98c-3e17d07d791d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:06.569884 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a884e971-426d-4735-a98c-3e17d07d791d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.271505 Aug 13 04:35:06.573656 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 474/932] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:06 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:07.051297 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0eaeac59-ef8c-4bd8-a537-c398f3c096c2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'create', calling method: .version_select at 0x7fc46c668550>, body: {"keypair": {"name": "tempest-keypair-709286893"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:07.070144 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-0eaeac59-ef8c-4bd8-a537-c398f3c096c2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for project 97bcef962215442fa34d9ef949492fc4. Resources: {'key_pairs'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:35:07.073936 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-0eaeac59-ef8c-4bd8-a537-c398f3c096c2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for user 79f213e02f8d44e789aae985fa15d58f and project 97bcef962215442fa34d9ef949492fc4. Resources: {'key_pairs'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:35:07.197985 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1114979848", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "9c9aa154-2553-4e43-a430-2b11cf059f5c"}], "security_groups": [{"name": "tempest-securitygroup--175212490"}], "key_name": "tempest-keypair-1193055186", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:07.290296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.network.neutron [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] validate_networks() for [('9c9aa154-2553-4e43-a430-2b11cf059f5c', None, None, None)] {{(pid=108287) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:35:07.370000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-0eaeac59-ef8c-4bd8-a537-c398f3c096c2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for project 97bcef962215442fa34d9ef949492fc4. Resources: {'key_pairs'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:35:07.373892 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-0eaeac59-ef8c-4bd8-a537-c398f3c096c2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for user 79f213e02f8d44e789aae985fa15d58f and project 97bcef962215442fa34d9ef949492fc4. Resources: {'key_pairs'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:35:07.387390 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0eaeac59-ef8c-4bd8-a537-c398f3c096c2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 2319 microversion: 2.20 time: 0.343477 Aug 13 04:35:07.387993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 459/933] 10.222.0.13 () {62 vars in 1199 bytes} [Fri Aug 13 04:35:07 2021] POST /compute/v2.1/os-keypairs => generated 2319 bytes in 345 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Aug 13 04:35:07.589782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-281839a0-fc9b-45f6-9c96-0ce8a187c02a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:07.590394 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-281839a0-fc9b-45f6-9c96-0ce8a187c02a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:07.597579 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-281839a0-fc9b-45f6-9c96-0ce8a187c02a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:07.598030 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-281839a0-fc9b-45f6-9c96-0ce8a187c02a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:07.598816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-281839a0-fc9b-45f6-9c96-0ce8a187c02a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:07.599246 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-281839a0-fc9b-45f6-9c96-0ce8a187c02a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:07.813576 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-281839a0-fc9b-45f6-9c96-0ce8a187c02a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:07.824374 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-281839a0-fc9b-45f6-9c96-0ce8a187c02a tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.238135 Aug 13 04:35:07.826782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 460/934] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:07 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:35:07.883143 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Flavor limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:35:07.883629 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Image limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:35:07.884296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Flavor pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:35:07.884743 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Image pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:35:07.885399 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:35:07.896641 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:07.897118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:07.898028 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:07.898494 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:07.917326 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for project 14887014218041cc86fddfa8a151dcd6. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:35:07.922569 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Getting quotas for user 45e5e56984454deb8f490bbf5a0f1435 and project 14887014218041cc86fddfa8a151dcd6. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:35:07.935297 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Going to run 1 instances... {{(pid=108287) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:35:07.938602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:35:07.988256 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1d9e999a-2c2e-43ac-afd7-96cb5702659d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.794061 Aug 13 04:35:07.989305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 475/935] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:35:07 2021] POST /compute/v2.1/servers => generated 401 bytes in 796 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 13 04:35:08.000444 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2f995d5e-f47f-4636-bd2e-bedaf5f1e904 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:08.001209 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2f995d5e-f47f-4636-bd2e-bedaf5f1e904 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:08.199349 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2f995d5e-f47f-4636-bd2e-bedaf5f1e904 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:08.207018 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2f995d5e-f47f-4636-bd2e-bedaf5f1e904 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1238 microversion: 2.1 time: 0.210878 Aug 13 04:35:08.207630 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 461/936] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:07 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1238 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:35:08.844569 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6ce5ac8b-eecd-4e49-aa66-b331b5edaa75 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:08.845207 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6ce5ac8b-eecd-4e49-aa66-b331b5edaa75 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:08.853631 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ce5ac8b-eecd-4e49-aa66-b331b5edaa75 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:08.854186 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ce5ac8b-eecd-4e49-aa66-b331b5edaa75 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:08.855108 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ce5ac8b-eecd-4e49-aa66-b331b5edaa75 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:08.855622 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ce5ac8b-eecd-4e49-aa66-b331b5edaa75 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:09.063813 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-6ce5ac8b-eecd-4e49-aa66-b331b5edaa75 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:09.073557 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6ce5ac8b-eecd-4e49-aa66-b331b5edaa75 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.234337 Aug 13 04:35:09.084378 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 476/937] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:08 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:09.151986 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-414368821", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "961a975f-b6bf-4b12-8622-52a8bd477fc6"}], "security_groups": [{"name": "tempest-securitygroup--1442963254"}], "key_name": "tempest-keypair-709286893", "user_data": "IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIHVidW50dSB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH51YnVudHUvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo="}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:09.224596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-108c1f82-0c32-4341-8643-eb7759cca08d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:09.225752 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-108c1f82-0c32-4341-8643-eb7759cca08d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:09.231858 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-108c1f82-0c32-4341-8643-eb7759cca08d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:09.232399 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-108c1f82-0c32-4341-8643-eb7759cca08d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:09.233854 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-108c1f82-0c32-4341-8643-eb7759cca08d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:09.234346 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-108c1f82-0c32-4341-8643-eb7759cca08d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:09.251396 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] validate_networks() for [('961a975f-b6bf-4b12-8622-52a8bd477fc6', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:35:09.336608 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-108c1f82-0c32-4341-8643-eb7759cca08d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:09.345468 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-108c1f82-0c32-4341-8643-eb7759cca08d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1290 microversion: 2.1 time: 0.124479 Aug 13 04:35:09.346377 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 477/938] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:09 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1290 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:09.908648 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:35:09.909186 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:35:09.909998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:35:09.910460 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:35:09.910963 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:35:09.921688 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:09.922094 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:09.923165 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:09.923624 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:09.940836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for project 97bcef962215442fa34d9ef949492fc4. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:35:09.944857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Getting quotas for user 79f213e02f8d44e789aae985fa15d58f and project 97bcef962215442fa34d9ef949492fc4. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:35:09.962594 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:35:09.965841 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:35:10.020800 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bd580e22-4ef9-4c4e-b8d8-bf383035ef3c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.873082 Aug 13 04:35:10.021466 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 462/939] 10.222.0.13 () {62 vars in 1188 bytes} [Fri Aug 13 04:35:09 2021] POST /compute/v2.1/servers => generated 402 bytes in 875 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Aug 13 04:35:10.032502 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-74995560-ecc9-4916-a022-a0cf50e2d3b0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:10.033416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-74995560-ecc9-4916-a022-a0cf50e2d3b0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:10.095206 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1b64b776-6398-4368-bbb9-3c271d371166 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:10.097118 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1b64b776-6398-4368-bbb9-3c271d371166 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:10.106899 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1b64b776-6398-4368-bbb9-3c271d371166 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:10.107569 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1b64b776-6398-4368-bbb9-3c271d371166 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:10.109517 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1b64b776-6398-4368-bbb9-3c271d371166 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:10.110161 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1b64b776-6398-4368-bbb9-3c271d371166 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:10.110575 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-74995560-ecc9-4916-a022-a0cf50e2d3b0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:10.121396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-74995560-ecc9-4916-a022-a0cf50e2d3b0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:10.126524 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-74995560-ecc9-4916-a022-a0cf50e2d3b0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:10.129239 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-74995560-ecc9-4916-a022-a0cf50e2d3b0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1280 microversion: 2.20 time: 0.101593 Aug 13 04:35:10.132854 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 478/940] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:10 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1280 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:35:10.352569 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1b64b776-6398-4368-bbb9-3c271d371166 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:10.363750 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1b64b776-6398-4368-bbb9-3c271d371166 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.275332 Aug 13 04:35:10.363959 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8b9702ed-0ece-4646-b07d-8bffd175959d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:10.364385 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8b9702ed-0ece-4646-b07d-8bffd175959d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:10.375721 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8b9702ed-0ece-4646-b07d-8bffd175959d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:10.376619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8b9702ed-0ece-4646-b07d-8bffd175959d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:10.377711 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8b9702ed-0ece-4646-b07d-8bffd175959d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:10.378683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8b9702ed-0ece-4646-b07d-8bffd175959d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:10.385621 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 463/941] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:10 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:35:10.633805 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8b9702ed-0ece-4646-b07d-8bffd175959d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:10.648076 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8b9702ed-0ece-4646-b07d-8bffd175959d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1363 microversion: 2.1 time: 0.287591 Aug 13 04:35:10.648340 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 479/942] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:10 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1363 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:35:11.154407 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c865bb77-6c65-472d-ba10-2d4c481aefb2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:11.155918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c865bb77-6c65-472d-ba10-2d4c481aefb2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:11.165069 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c865bb77-6c65-472d-ba10-2d4c481aefb2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:11.165970 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c865bb77-6c65-472d-ba10-2d4c481aefb2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:11.167286 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c865bb77-6c65-472d-ba10-2d4c481aefb2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:11.167920 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c865bb77-6c65-472d-ba10-2d4c481aefb2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:11.246826 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c865bb77-6c65-472d-ba10-2d4c481aefb2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:11.257533 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c865bb77-6c65-472d-ba10-2d4c481aefb2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:11.259479 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c865bb77-6c65-472d-ba10-2d4c481aefb2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:11.260952 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c865bb77-6c65-472d-ba10-2d4c481aefb2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1332 microversion: 2.20 time: 0.113298 Aug 13 04:35:11.261772 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 464/943] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:11 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:11.311582 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-74ff7c36-c525-46a2-8f4d-8d7ddf0705a0 req-e2b7e267-1709-4209-aeab-e85fb2c28930 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8018e3b0-c3af-49a1-bbca-3123c9573244", "tag": "9aa0221a-92be-4f44-b2cb-e932740ff8ae"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:11.314475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:35:11.314475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:35:11.324684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-74ff7c36-c525-46a2-8f4d-8d7ddf0705a0 req-e2b7e267-1709-4209-aeab-e85fb2c28930 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:11.325135 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-74ff7c36-c525-46a2-8f4d-8d7ddf0705a0 req-e2b7e267-1709-4209-aeab-e85fb2c28930 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:11.340939 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-74ff7c36-c525-46a2-8f4d-8d7ddf0705a0 req-e2b7e267-1709-4209-aeab-e85fb2c28930 service nova] Creating event network-changed:9aa0221a-92be-4f44-b2cb-e932740ff8ae for instance 8018e3b0-c3af-49a1-bbca-3123c9573244 on hv-cinder-75996 Aug 13 04:35:11.349819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-74ff7c36-c525-46a2-8f4d-8d7ddf0705a0 req-e2b7e267-1709-4209-aeab-e85fb2c28930 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041556 Aug 13 04:35:11.352149 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 480/944] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:35:11 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:35:11.396883 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a09399ed-0eac-4761-9b78-8ca01c7975dd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:11.398131 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a09399ed-0eac-4761-9b78-8ca01c7975dd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:11.404505 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a09399ed-0eac-4761-9b78-8ca01c7975dd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:11.404997 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a09399ed-0eac-4761-9b78-8ca01c7975dd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:11.406918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a09399ed-0eac-4761-9b78-8ca01c7975dd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:11.407652 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a09399ed-0eac-4761-9b78-8ca01c7975dd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:11.609639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a09399ed-0eac-4761-9b78-8ca01c7975dd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:11.619288 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a09399ed-0eac-4761-9b78-8ca01c7975dd tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.230495 Aug 13 04:35:11.620035 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 465/945] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:11 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:11.666046 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-fefc97bd-93be-4628-9007-0f4a62e019b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:11.668158 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-fefc97bd-93be-4628-9007-0f4a62e019b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:11.674950 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fefc97bd-93be-4628-9007-0f4a62e019b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:11.675618 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fefc97bd-93be-4628-9007-0f4a62e019b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:11.676841 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fefc97bd-93be-4628-9007-0f4a62e019b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:11.677834 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fefc97bd-93be-4628-9007-0f4a62e019b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:11.920081 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-fefc97bd-93be-4628-9007-0f4a62e019b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:11.942430 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-fefc97bd-93be-4628-9007-0f4a62e019b3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1363 microversion: 2.1 time: 0.280407 Aug 13 04:35:11.960299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 481/946] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:11 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1363 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:12.280572 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-915ce3aa-2c67-4139-935d-63c08dfb9b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:12.281181 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-915ce3aa-2c67-4139-935d-63c08dfb9b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:12.291510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-915ce3aa-2c67-4139-935d-63c08dfb9b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:12.291997 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-915ce3aa-2c67-4139-935d-63c08dfb9b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:12.292780 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-915ce3aa-2c67-4139-935d-63c08dfb9b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:12.293209 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-915ce3aa-2c67-4139-935d-63c08dfb9b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:12.533185 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-915ce3aa-2c67-4139-935d-63c08dfb9b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:12.544854 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-915ce3aa-2c67-4139-935d-63c08dfb9b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:12.547177 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-915ce3aa-2c67-4139-935d-63c08dfb9b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:12.548274 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-915ce3aa-2c67-4139-935d-63c08dfb9b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1406 microversion: 2.20 time: 0.271846 Aug 13 04:35:12.549000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 466/947] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:12 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1406 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:12.636272 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a73ce4b5-5a85-4db0-b14f-c30cd37d301d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:12.636978 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a73ce4b5-5a85-4db0-b14f-c30cd37d301d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:12.643420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a73ce4b5-5a85-4db0-b14f-c30cd37d301d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:12.644182 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a73ce4b5-5a85-4db0-b14f-c30cd37d301d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:12.645044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a73ce4b5-5a85-4db0-b14f-c30cd37d301d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:12.645593 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a73ce4b5-5a85-4db0-b14f-c30cd37d301d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:12.787943 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a73ce4b5-5a85-4db0-b14f-c30cd37d301d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:12.799216 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a73ce4b5-5a85-4db0-b14f-c30cd37d301d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.166537 Aug 13 04:35:12.799803 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 482/948] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:12 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:12.963739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-77546a53-6d13-4b3a-92bc-b293fc4ce582 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:12.964607 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-77546a53-6d13-4b3a-92bc-b293fc4ce582 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:12.971497 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-77546a53-6d13-4b3a-92bc-b293fc4ce582 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:12.971924 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-77546a53-6d13-4b3a-92bc-b293fc4ce582 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:12.972825 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-77546a53-6d13-4b3a-92bc-b293fc4ce582 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:12.973448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-77546a53-6d13-4b3a-92bc-b293fc4ce582 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:13.007054 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-32782e47-f53e-42c5-b951-5ef30dda5a5f req-2cc71e14-7073-46a9-bb1a-a7a604361a91 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f3dbb4-dc66-4923-95f0-d53a986ebf82", "tag": "25bafb0e-0d63-4fa6-a942-fc8e07163718"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:13.008607 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:35:13.008607 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:35:13.030839 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-32782e47-f53e-42c5-b951-5ef30dda5a5f req-2cc71e14-7073-46a9-bb1a-a7a604361a91 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:13.031573 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-32782e47-f53e-42c5-b951-5ef30dda5a5f req-2cc71e14-7073-46a9-bb1a-a7a604361a91 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:13.043023 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-32782e47-f53e-42c5-b951-5ef30dda5a5f req-2cc71e14-7073-46a9-bb1a-a7a604361a91 service nova] Creating event network-changed:25bafb0e-0d63-4fa6-a942-fc8e07163718 for instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 on hv-cinder-75996 Aug 13 04:35:13.049268 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-32782e47-f53e-42c5-b951-5ef30dda5a5f req-2cc71e14-7073-46a9-bb1a-a7a604361a91 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046035 Aug 13 04:35:13.050700 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 483/949] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:35:13 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:35:13.157504 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-77546a53-6d13-4b3a-92bc-b293fc4ce582 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:13.170186 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-77546a53-6d13-4b3a-92bc-b293fc4ce582 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1363 microversion: 2.1 time: 0.207408 Aug 13 04:35:13.170186 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 467/950] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:12 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1363 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:13.566939 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-888a7ffd-8272-4e11-aab9-12b640302d5f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:13.567749 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-888a7ffd-8272-4e11-aab9-12b640302d5f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:13.574223 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-888a7ffd-8272-4e11-aab9-12b640302d5f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:13.574676 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-888a7ffd-8272-4e11-aab9-12b640302d5f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:13.575487 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-888a7ffd-8272-4e11-aab9-12b640302d5f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:13.575929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-888a7ffd-8272-4e11-aab9-12b640302d5f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:13.699735 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-888a7ffd-8272-4e11-aab9-12b640302d5f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:13.707735 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-888a7ffd-8272-4e11-aab9-12b640302d5f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:13.709224 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-888a7ffd-8272-4e11-aab9-12b640302d5f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:13.710321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-888a7ffd-8272-4e11-aab9-12b640302d5f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1406 microversion: 2.20 time: 0.147481 Aug 13 04:35:13.710875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 484/951] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:13 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1406 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:13.817207 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-477e8493-a8af-46d1-9743-2fead50d0156 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:13.817834 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-477e8493-a8af-46d1-9743-2fead50d0156 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:13.823659 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-477e8493-a8af-46d1-9743-2fead50d0156 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:13.824098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-477e8493-a8af-46d1-9743-2fead50d0156 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:13.824861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-477e8493-a8af-46d1-9743-2fead50d0156 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:13.825288 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-477e8493-a8af-46d1-9743-2fead50d0156 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:13.951773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-477e8493-a8af-46d1-9743-2fead50d0156 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:13.960428 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-477e8493-a8af-46d1-9743-2fead50d0156 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.146982 Aug 13 04:35:13.961008 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 468/952] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:13 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:14.184343 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b674ecd4-97c1-49d2-be17-6e6352ed14f8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:14.185032 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b674ecd4-97c1-49d2-be17-6e6352ed14f8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:14.191502 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b674ecd4-97c1-49d2-be17-6e6352ed14f8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:14.191944 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b674ecd4-97c1-49d2-be17-6e6352ed14f8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:14.192703 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b674ecd4-97c1-49d2-be17-6e6352ed14f8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:14.193133 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b674ecd4-97c1-49d2-be17-6e6352ed14f8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:14.318927 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b674ecd4-97c1-49d2-be17-6e6352ed14f8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:14.327476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b674ecd4-97c1-49d2-be17-6e6352ed14f8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1363 microversion: 2.1 time: 0.146463 Aug 13 04:35:14.328222 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 485/953] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:14 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:14.728592 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7760f7ed-da00-4f72-9c5b-16df47e80c8a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:14.729199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7760f7ed-da00-4f72-9c5b-16df47e80c8a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:14.735386 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7760f7ed-da00-4f72-9c5b-16df47e80c8a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:14.735859 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7760f7ed-da00-4f72-9c5b-16df47e80c8a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:14.736626 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7760f7ed-da00-4f72-9c5b-16df47e80c8a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:14.737055 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7760f7ed-da00-4f72-9c5b-16df47e80c8a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:14.860630 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7760f7ed-da00-4f72-9c5b-16df47e80c8a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:14.868558 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7760f7ed-da00-4f72-9c5b-16df47e80c8a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:14.870372 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7760f7ed-da00-4f72-9c5b-16df47e80c8a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:14.871621 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7760f7ed-da00-4f72-9c5b-16df47e80c8a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1406 microversion: 2.20 time: 0.147013 Aug 13 04:35:14.872180 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 469/954] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:14 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1406 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:14.978050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4ada6fbb-e714-4287-b650-d8af10261e2e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:14.978695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4ada6fbb-e714-4287-b650-d8af10261e2e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:14.985064 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4ada6fbb-e714-4287-b650-d8af10261e2e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:14.985542 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4ada6fbb-e714-4287-b650-d8af10261e2e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:14.986325 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4ada6fbb-e714-4287-b650-d8af10261e2e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:14.986763 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4ada6fbb-e714-4287-b650-d8af10261e2e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:15.121557 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4ada6fbb-e714-4287-b650-d8af10261e2e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:15.130390 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4ada6fbb-e714-4287-b650-d8af10261e2e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.155984 Aug 13 04:35:15.130957 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 486/955] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:14 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:15.209093 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-f080466c-7438-4968-9adf-a99afc679a0b req-f1def6f2-aaa9-4f04-a006-4a64360cb67f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8018e3b0-c3af-49a1-bbca-3123c9573244", "name": "network-vif-plugged", "status": "completed", "tag": "9aa0221a-92be-4f44-b2cb-e932740ff8ae"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:15.210717 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:35:15.210717 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:35:15.217700 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-f080466c-7438-4968-9adf-a99afc679a0b req-f1def6f2-aaa9-4f04-a006-4a64360cb67f service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:15.218732 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-f080466c-7438-4968-9adf-a99afc679a0b req-f1def6f2-aaa9-4f04-a006-4a64360cb67f service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:15.229525 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-f080466c-7438-4968-9adf-a99afc679a0b req-f1def6f2-aaa9-4f04-a006-4a64360cb67f service nova] Creating event network-vif-plugged:9aa0221a-92be-4f44-b2cb-e932740ff8ae for instance 8018e3b0-c3af-49a1-bbca-3123c9573244 on hv-cinder-75996 Aug 13 04:35:15.236226 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-f080466c-7438-4968-9adf-a99afc679a0b req-f1def6f2-aaa9-4f04-a006-4a64360cb67f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030044 Aug 13 04:35:15.236997 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 470/956] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:35:15 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:35:15.345565 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-528a00d5-15d1-4727-8764-85d09633cbb6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:15.346229 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-528a00d5-15d1-4727-8764-85d09633cbb6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:15.352732 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-528a00d5-15d1-4727-8764-85d09633cbb6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:15.353525 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-528a00d5-15d1-4727-8764-85d09633cbb6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:15.354437 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-528a00d5-15d1-4727-8764-85d09633cbb6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:15.354992 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-528a00d5-15d1-4727-8764-85d09633cbb6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:15.481209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-528a00d5-15d1-4727-8764-85d09633cbb6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:15.489526 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-528a00d5-15d1-4727-8764-85d09633cbb6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1363 microversion: 2.1 time: 0.148180 Aug 13 04:35:15.490102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 487/957] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:15 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1363 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:15.892518 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-242bf769-1058-48a3-a2c3-24783067cfd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:15.893199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-242bf769-1058-48a3-a2c3-24783067cfd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:15.899461 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-242bf769-1058-48a3-a2c3-24783067cfd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:15.899915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-242bf769-1058-48a3-a2c3-24783067cfd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:15.900751 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-242bf769-1058-48a3-a2c3-24783067cfd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:15.901175 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-242bf769-1058-48a3-a2c3-24783067cfd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:16.027742 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-242bf769-1058-48a3-a2c3-24783067cfd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:16.036085 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-242bf769-1058-48a3-a2c3-24783067cfd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:16.037595 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-242bf769-1058-48a3-a2c3-24783067cfd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:16.038658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-242bf769-1058-48a3-a2c3-24783067cfd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1406 microversion: 2.20 time: 0.151421 Aug 13 04:35:16.039210 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 471/958] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:15 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1406 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:16.147719 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2dac08e2-7e13-4859-aaa2-13ae46314165 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:16.148339 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2dac08e2-7e13-4859-aaa2-13ae46314165 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:16.154557 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2dac08e2-7e13-4859-aaa2-13ae46314165 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:16.155503 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2dac08e2-7e13-4859-aaa2-13ae46314165 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:16.156040 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2dac08e2-7e13-4859-aaa2-13ae46314165 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:16.156479 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2dac08e2-7e13-4859-aaa2-13ae46314165 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:16.285066 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2dac08e2-7e13-4859-aaa2-13ae46314165 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:16.293017 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2dac08e2-7e13-4859-aaa2-13ae46314165 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.149027 Aug 13 04:35:16.293615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 488/959] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:16 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:16.509640 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3119a09a-567b-424f-9dee-da1a841e0dcd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:16.510158 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3119a09a-567b-424f-9dee-da1a841e0dcd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:16.516339 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3119a09a-567b-424f-9dee-da1a841e0dcd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:16.516773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3119a09a-567b-424f-9dee-da1a841e0dcd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:16.517561 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3119a09a-567b-424f-9dee-da1a841e0dcd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:16.517990 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3119a09a-567b-424f-9dee-da1a841e0dcd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:16.638436 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3119a09a-567b-424f-9dee-da1a841e0dcd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:16.646420 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3119a09a-567b-424f-9dee-da1a841e0dcd tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1548 microversion: 2.1 time: 0.140502 Aug 13 04:35:16.646991 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 472/960] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:16 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1548 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:35:16.663141 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-caa2e4d4-1a94-4bcb-b01e-5911181f7554 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:16.663642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-caa2e4d4-1a94-4bcb-b01e-5911181f7554 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:16.669632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-caa2e4d4-1a94-4bcb-b01e-5911181f7554 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:16.670086 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-caa2e4d4-1a94-4bcb-b01e-5911181f7554 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:16.670905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-caa2e4d4-1a94-4bcb-b01e-5911181f7554 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:16.671350 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-caa2e4d4-1a94-4bcb-b01e-5911181f7554 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:16.755083 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-caa2e4d4-1a94-4bcb-b01e-5911181f7554 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095574 Aug 13 04:35:16.755679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 489/961] 10.222.0.13 () {58 vars in 1275 bytes} [Fri Aug 13 04:35:16 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:35:17.057990 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-df73cf55-7088-495b-9434-edfc79c54b91 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:17.059548 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-df73cf55-7088-495b-9434-edfc79c54b91 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:17.067802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-df73cf55-7088-495b-9434-edfc79c54b91 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:17.068563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-df73cf55-7088-495b-9434-edfc79c54b91 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:17.069939 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-df73cf55-7088-495b-9434-edfc79c54b91 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:17.070757 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-df73cf55-7088-495b-9434-edfc79c54b91 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:17.254388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-c4be1088-7640-4951-88f8-7c3de37ab262 req-c1a8ca1e-c040-44ae-8666-4da6b5c27d4d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f3dbb4-dc66-4923-95f0-d53a986ebf82", "name": "network-vif-plugged", "status": "completed", "tag": "25bafb0e-0d63-4fa6-a942-fc8e07163718"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:17.257198 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:35:17.257198 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:35:17.266899 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-c4be1088-7640-4951-88f8-7c3de37ab262 req-c1a8ca1e-c040-44ae-8666-4da6b5c27d4d service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:17.267783 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-c4be1088-7640-4951-88f8-7c3de37ab262 req-c1a8ca1e-c040-44ae-8666-4da6b5c27d4d service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:17.282226 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-c4be1088-7640-4951-88f8-7c3de37ab262 req-c1a8ca1e-c040-44ae-8666-4da6b5c27d4d service nova] Creating event network-vif-plugged:25bafb0e-0d63-4fa6-a942-fc8e07163718 for instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 on hv-cinder-75996 Aug 13 04:35:17.288012 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-c4be1088-7640-4951-88f8-7c3de37ab262 req-c1a8ca1e-c040-44ae-8666-4da6b5c27d4d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037144 Aug 13 04:35:17.289085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 490/962] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:35:17 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:35:17.317800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a919a5a9-f024-42ac-aa23-6bc548855513 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:17.321643 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a919a5a9-f024-42ac-aa23-6bc548855513 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:17.335280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a919a5a9-f024-42ac-aa23-6bc548855513 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:17.336110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a919a5a9-f024-42ac-aa23-6bc548855513 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:17.336922 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a919a5a9-f024-42ac-aa23-6bc548855513 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:17.337367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a919a5a9-f024-42ac-aa23-6bc548855513 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:17.339856 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-df73cf55-7088-495b-9434-edfc79c54b91 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:17.348937 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-df73cf55-7088-495b-9434-edfc79c54b91 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:17.355941 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-df73cf55-7088-495b-9434-edfc79c54b91 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:17.358232 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-df73cf55-7088-495b-9434-edfc79c54b91 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1406 microversion: 2.20 time: 0.305540 Aug 13 04:35:17.359367 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 473/963] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:17 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1406 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:17.850339 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a919a5a9-f024-42ac-aa23-6bc548855513 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:17.858343 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a919a5a9-f024-42ac-aa23-6bc548855513 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.550200 Aug 13 04:35:17.859128 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 491/964] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:17 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:35:18.163818 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f6e8e6fb-8659-4b58-9236-85363c07b9a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:18.164986 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f6e8e6fb-8659-4b58-9236-85363c07b9a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:18.166335 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-f9ae12e1-230a-40cc-a41c-7c248f7abca2 req-4ad5eaea-1368-482a-a17d-b72a83db010a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8018e3b0-c3af-49a1-bbca-3123c9573244", "tag": "9aa0221a-92be-4f44-b2cb-e932740ff8ae"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:18.167985 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:35:18.167985 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:35:18.172719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f6e8e6fb-8659-4b58-9236-85363c07b9a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:18.173248 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f6e8e6fb-8659-4b58-9236-85363c07b9a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:18.174522 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f6e8e6fb-8659-4b58-9236-85363c07b9a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:18.175027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f6e8e6fb-8659-4b58-9236-85363c07b9a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:18.175972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-f9ae12e1-230a-40cc-a41c-7c248f7abca2 req-4ad5eaea-1368-482a-a17d-b72a83db010a service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:18.176507 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-f9ae12e1-230a-40cc-a41c-7c248f7abca2 req-4ad5eaea-1368-482a-a17d-b72a83db010a service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:18.189818 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-f9ae12e1-230a-40cc-a41c-7c248f7abca2 req-4ad5eaea-1368-482a-a17d-b72a83db010a service nova] Creating event network-changed:9aa0221a-92be-4f44-b2cb-e932740ff8ae for instance 8018e3b0-c3af-49a1-bbca-3123c9573244 on hv-cinder-75996 Aug 13 04:35:18.194758 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-f9ae12e1-230a-40cc-a41c-7c248f7abca2 req-4ad5eaea-1368-482a-a17d-b72a83db010a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031958 Aug 13 04:35:18.196206 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 492/965] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:35:18 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:35:18.252218 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f6e8e6fb-8659-4b58-9236-85363c07b9a3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 14 microversion: 2.1 time: 0.090419 Aug 13 04:35:18.252892 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 474/966] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:18 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 14 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:35:18.377656 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-fe62b643-eb8b-47a1-bfb5-bae990e39d08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:18.378962 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-fe62b643-eb8b-47a1-bfb5-bae990e39d08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:18.386914 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fe62b643-eb8b-47a1-bfb5-bae990e39d08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:18.387501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fe62b643-eb8b-47a1-bfb5-bae990e39d08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:18.388431 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fe62b643-eb8b-47a1-bfb5-bae990e39d08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:18.388868 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fe62b643-eb8b-47a1-bfb5-bae990e39d08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:18.549810 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-fe62b643-eb8b-47a1-bfb5-bae990e39d08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:18.557976 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-fe62b643-eb8b-47a1-bfb5-bae990e39d08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:18.559315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-fe62b643-eb8b-47a1-bfb5-bae990e39d08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:18.560649 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-fe62b643-eb8b-47a1-bfb5-bae990e39d08 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1596 microversion: 2.20 time: 0.187932 Aug 13 04:35:18.562639 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 493/967] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:35:18 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1596 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:18.580294 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4a919fac-90df-4542-a0a7-499c162a3bf1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:18.581328 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4a919fac-90df-4542-a0a7-499c162a3bf1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:18.589536 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a919fac-90df-4542-a0a7-499c162a3bf1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:18.590234 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a919fac-90df-4542-a0a7-499c162a3bf1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:18.591841 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a919fac-90df-4542-a0a7-499c162a3bf1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:18.596353 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4a919fac-90df-4542-a0a7-499c162a3bf1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:18.691039 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4a919fac-90df-4542-a0a7-499c162a3bf1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.115041 Aug 13 04:35:18.691983 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 475/968] 10.222.0.13 () {60 vars in 1316 bytes} [Fri Aug 13 04:35:18 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/os-interface => generated 284 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:35:18.878029 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-da66065b-80b5-4dd2-bfd9-72b939f833f2 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:18.879089 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-da66065b-80b5-4dd2-bfd9-72b939f833f2 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:18.887557 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-da66065b-80b5-4dd2-bfd9-72b939f833f2 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:18.888592 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-da66065b-80b5-4dd2-bfd9-72b939f833f2 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:18.890296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-da66065b-80b5-4dd2-bfd9-72b939f833f2 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:18.892059 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-da66065b-80b5-4dd2-bfd9-72b939f833f2 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:19.163404 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-da66065b-80b5-4dd2-bfd9-72b939f833f2 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:19.174513 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-da66065b-80b5-4dd2-bfd9-72b939f833f2 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1757 microversion: 2.1 time: 0.302954 Aug 13 04:35:19.175693 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 494/969] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:18 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1757 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:19.263112 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0181df7b-e1e0-4da3-b123-5cb4e14d155f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:19.264931 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0181df7b-e1e0-4da3-b123-5cb4e14d155f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:19.271504 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0181df7b-e1e0-4da3-b123-5cb4e14d155f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:19.271960 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0181df7b-e1e0-4da3-b123-5cb4e14d155f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:19.272769 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0181df7b-e1e0-4da3-b123-5cb4e14d155f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:19.273639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0181df7b-e1e0-4da3-b123-5cb4e14d155f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:19.338554 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0181df7b-e1e0-4da3-b123-5cb4e14d155f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 14 microversion: 2.1 time: 0.078910 Aug 13 04:35:19.339185 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 476/970] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:19 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 14 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:35:19.796888 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0c552799-0b81-4d81-ba41-30c5fe667e03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:19.797879 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0c552799-0b81-4d81-ba41-30c5fe667e03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:19.804279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0c552799-0b81-4d81-ba41-30c5fe667e03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:19.804712 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0c552799-0b81-4d81-ba41-30c5fe667e03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:19.805516 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0c552799-0b81-4d81-ba41-30c5fe667e03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:19.805945 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0c552799-0b81-4d81-ba41-30c5fe667e03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:19.864865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0c552799-0b81-4d81-ba41-30c5fe667e03 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 14 microversion: 2.20 time: 0.072103 Aug 13 04:35:19.865660 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 495/971] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:19 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:20.193332 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-43c1e187-b67c-437a-8be7-1a137fd3b56e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:20.194377 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-43c1e187-b67c-437a-8be7-1a137fd3b56e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:20.201330 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-43c1e187-b67c-437a-8be7-1a137fd3b56e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:20.202011 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-43c1e187-b67c-437a-8be7-1a137fd3b56e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:20.203519 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-43c1e187-b67c-437a-8be7-1a137fd3b56e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:20.204335 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-43c1e187-b67c-437a-8be7-1a137fd3b56e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:20.213576 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-4f333f7e-7c2c-45a1-9e52-da1553a9ba93 req-0c0037e2-8b90-4c2b-b023-502377d9ef32 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15f3dbb4-dc66-4923-95f0-d53a986ebf82", "tag": "25bafb0e-0d63-4fa6-a942-fc8e07163718"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:20.215937 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:35:20.215937 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:35:20.224959 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-4f333f7e-7c2c-45a1-9e52-da1553a9ba93 req-0c0037e2-8b90-4c2b-b023-502377d9ef32 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:20.225544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-4f333f7e-7c2c-45a1-9e52-da1553a9ba93 req-0c0037e2-8b90-4c2b-b023-502377d9ef32 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:20.241033 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-4f333f7e-7c2c-45a1-9e52-da1553a9ba93 req-0c0037e2-8b90-4c2b-b023-502377d9ef32 service nova] Creating event network-changed:25bafb0e-0d63-4fa6-a942-fc8e07163718 for instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 on hv-cinder-75996 Aug 13 04:35:20.247323 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-4f333f7e-7c2c-45a1-9e52-da1553a9ba93 req-0c0037e2-8b90-4c2b-b023-502377d9ef32 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038678 Aug 13 04:35:20.248477 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 496/972] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:35:20 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:35:20.350817 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ee8630aa-81c8-419b-9646-6ac7444e4be0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:20.352260 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ee8630aa-81c8-419b-9646-6ac7444e4be0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:20.360835 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-43c1e187-b67c-437a-8be7-1a137fd3b56e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:20.368961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-43c1e187-b67c-437a-8be7-1a137fd3b56e tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1760 microversion: 2.1 time: 0.180066 Aug 13 04:35:20.369619 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 477/973] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:20 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1760 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:20.370695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ee8630aa-81c8-419b-9646-6ac7444e4be0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:20.371324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ee8630aa-81c8-419b-9646-6ac7444e4be0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:20.373160 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ee8630aa-81c8-419b-9646-6ac7444e4be0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:20.373837 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ee8630aa-81c8-419b-9646-6ac7444e4be0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:20.441167 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ee8630aa-81c8-419b-9646-6ac7444e4be0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 14 microversion: 2.1 time: 0.095028 Aug 13 04:35:20.444529 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 497/974] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:20 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 14 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 13 04:35:20.876408 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ee10f52a-71b8-4771-a389-231aa8f242c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:20.877474 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ee10f52a-71b8-4771-a389-231aa8f242c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:20.883784 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee10f52a-71b8-4771-a389-231aa8f242c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:20.884231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee10f52a-71b8-4771-a389-231aa8f242c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:20.885008 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee10f52a-71b8-4771-a389-231aa8f242c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:20.885455 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee10f52a-71b8-4771-a389-231aa8f242c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:20.944303 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ee10f52a-71b8-4771-a389-231aa8f242c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 14 microversion: 2.20 time: 0.072057 Aug 13 04:35:20.944927 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 478/975] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:20 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:21.453606 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-75312089-426c-4437-b0af-e39afd92f241 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:21.454608 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-75312089-426c-4437-b0af-e39afd92f241 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:21.461261 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-75312089-426c-4437-b0af-e39afd92f241 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:21.461663 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-75312089-426c-4437-b0af-e39afd92f241 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:21.462440 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-75312089-426c-4437-b0af-e39afd92f241 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:21.462902 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-75312089-426c-4437-b0af-e39afd92f241 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:21.521070 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-75312089-426c-4437-b0af-e39afd92f241 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 14 microversion: 2.1 time: 0.072306 Aug 13 04:35:21.521753 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 498/976] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:21 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 14 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 13 04:35:21.958069 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-dcae343f-4b87-49b5-ab64-f598e62d35d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:21.958984 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-dcae343f-4b87-49b5-ab64-f598e62d35d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:21.965748 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dcae343f-4b87-49b5-ab64-f598e62d35d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:21.966325 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dcae343f-4b87-49b5-ab64-f598e62d35d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:21.967592 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dcae343f-4b87-49b5-ab64-f598e62d35d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:21.968032 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dcae343f-4b87-49b5-ab64-f598e62d35d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:22.035859 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-dcae343f-4b87-49b5-ab64-f598e62d35d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 14 microversion: 2.20 time: 0.083950 Aug 13 04:35:22.036650 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 479/977] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:21 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 14 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:22.532201 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ec3a33d3-3f95-47c7-bc31-9fba8f9c851e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:22.533193 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ec3a33d3-3f95-47c7-bc31-9fba8f9c851e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:22.539589 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ec3a33d3-3f95-47c7-bc31-9fba8f9c851e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:22.540034 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ec3a33d3-3f95-47c7-bc31-9fba8f9c851e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:22.540790 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ec3a33d3-3f95-47c7-bc31-9fba8f9c851e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:22.541221 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ec3a33d3-3f95-47c7-bc31-9fba8f9c851e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:22.597442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ec3a33d3-3f95-47c7-bc31-9fba8f9c851e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 14 microversion: 2.1 time: 0.069244 Aug 13 04:35:22.598073 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 499/978] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:22 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 14 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:35:23.048249 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2d2e8780-1bf9-4bca-bc55-58b5b65f8eac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:23.049411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2d2e8780-1bf9-4bca-bc55-58b5b65f8eac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:23.056593 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d2e8780-1bf9-4bca-bc55-58b5b65f8eac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:23.057074 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d2e8780-1bf9-4bca-bc55-58b5b65f8eac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:23.058030 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d2e8780-1bf9-4bca-bc55-58b5b65f8eac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:23.058564 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2d2e8780-1bf9-4bca-bc55-58b5b65f8eac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:23.132601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2d2e8780-1bf9-4bca-bc55-58b5b65f8eac tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 14 microversion: 2.20 time: 0.089058 Aug 13 04:35:23.133144 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 480/979] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:23 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 14 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:23.609666 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ff3f6edc-4e7b-4a55-bbef-c52949e6857e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:23.610536 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ff3f6edc-4e7b-4a55-bbef-c52949e6857e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:23.617456 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ff3f6edc-4e7b-4a55-bbef-c52949e6857e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:23.617926 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ff3f6edc-4e7b-4a55-bbef-c52949e6857e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:23.618715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ff3f6edc-4e7b-4a55-bbef-c52949e6857e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:23.619153 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ff3f6edc-4e7b-4a55-bbef-c52949e6857e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:23.684920 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ff3f6edc-4e7b-4a55-bbef-c52949e6857e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 14 microversion: 2.1 time: 0.080281 Aug 13 04:35:23.685604 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 500/980] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:23 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 14 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:35:24.143894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f730c9d0-104a-4041-845c-94ba13df0c66 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:24.144863 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f730c9d0-104a-4041-845c-94ba13df0c66 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:24.151565 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f730c9d0-104a-4041-845c-94ba13df0c66 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:24.152000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f730c9d0-104a-4041-845c-94ba13df0c66 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:24.152757 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f730c9d0-104a-4041-845c-94ba13df0c66 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:24.153177 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f730c9d0-104a-4041-845c-94ba13df0c66 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:24.213127 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f730c9d0-104a-4041-845c-94ba13df0c66 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 14 microversion: 2.20 time: 0.073094 Aug 13 04:35:24.214001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 481/981] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:24 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 14 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:24.696366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e880aa7e-4005-4ee3-a882-1c2293a5e20f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:24.697412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e880aa7e-4005-4ee3-a882-1c2293a5e20f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:24.704159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e880aa7e-4005-4ee3-a882-1c2293a5e20f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:24.704663 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e880aa7e-4005-4ee3-a882-1c2293a5e20f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:24.705489 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e880aa7e-4005-4ee3-a882-1c2293a5e20f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:24.705939 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e880aa7e-4005-4ee3-a882-1c2293a5e20f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:24.773472 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e880aa7e-4005-4ee3-a882-1c2293a5e20f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 14 microversion: 2.1 time: 0.080873 Aug 13 04:35:24.774222 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 501/982] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:24 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 14 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:35:25.226149 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fa59cb3a-5614-4a96-ab03-f70f038c821d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:25.227195 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fa59cb3a-5614-4a96-ab03-f70f038c821d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:25.234227 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa59cb3a-5614-4a96-ab03-f70f038c821d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:25.234721 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa59cb3a-5614-4a96-ab03-f70f038c821d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:25.235526 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa59cb3a-5614-4a96-ab03-f70f038c821d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:25.235989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fa59cb3a-5614-4a96-ab03-f70f038c821d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:25.785068 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e7e61ec7-eaae-48d7-a068-2418bf55976c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:25.786188 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e7e61ec7-eaae-48d7-a068-2418bf55976c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:25.793002 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e7e61ec7-eaae-48d7-a068-2418bf55976c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:25.793489 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e7e61ec7-eaae-48d7-a068-2418bf55976c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:25.794263 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e7e61ec7-eaae-48d7-a068-2418bf55976c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:25.794709 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e7e61ec7-eaae-48d7-a068-2418bf55976c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:28.101067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fa59cb3a-5614-4a96-ab03-f70f038c821d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 14 microversion: 2.20 time: 2.879362 Aug 13 04:35:28.101829 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 482/983] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:25 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 14 bytes in 2881 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:28.114924 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e7e61ec7-eaae-48d7-a068-2418bf55976c tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 14 microversion: 2.1 time: 2.334046 Aug 13 04:35:28.115572 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 502/984] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:25 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 14 bytes in 2336 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 13 04:35:29.113214 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-46fe5bc5-9e71-4f8a-a556-bc67a4da870f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:29.114265 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-46fe5bc5-9e71-4f8a-a556-bc67a4da870f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:29.121145 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-46fe5bc5-9e71-4f8a-a556-bc67a4da870f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:29.121658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-46fe5bc5-9e71-4f8a-a556-bc67a4da870f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:29.122483 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-46fe5bc5-9e71-4f8a-a556-bc67a4da870f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:29.122923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-46fe5bc5-9e71-4f8a-a556-bc67a4da870f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:29.126407 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d16f8b86-d45c-476f-9f97-9d64f43f29f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:29.127402 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d16f8b86-d45c-476f-9f97-9d64f43f29f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:29.133919 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d16f8b86-d45c-476f-9f97-9d64f43f29f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:29.134363 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d16f8b86-d45c-476f-9f97-9d64f43f29f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:29.135137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d16f8b86-d45c-476f-9f97-9d64f43f29f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:29.135571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d16f8b86-d45c-476f-9f97-9d64f43f29f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:31.461866 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-46fe5bc5-9e71-4f8a-a556-bc67a4da870f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 14 microversion: 2.20 time: 2.352720 Aug 13 04:35:31.462687 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 483/985] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:29 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 14 bytes in 2355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:31.478036 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d16f8b86-d45c-476f-9f97-9d64f43f29f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 12758 microversion: 2.1 time: 2.356121 Aug 13 04:35:31.478672 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 503/986] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:29 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 12758 bytes in 2358 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:32.473420 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4ea97da9-3ed0-4ede-be6e-b61fb92a735c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:32.474521 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4ea97da9-3ed0-4ede-be6e-b61fb92a735c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:32.480897 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4ea97da9-3ed0-4ede-be6e-b61fb92a735c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:32.481346 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4ea97da9-3ed0-4ede-be6e-b61fb92a735c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:32.482143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4ea97da9-3ed0-4ede-be6e-b61fb92a735c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:32.482677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4ea97da9-3ed0-4ede-be6e-b61fb92a735c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:32.489625 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ce924b45-a22e-4dcc-b2a3-7b79b19cbc7e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:32.490675 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ce924b45-a22e-4dcc-b2a3-7b79b19cbc7e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:32.497267 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ce924b45-a22e-4dcc-b2a3-7b79b19cbc7e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:32.498121 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ce924b45-a22e-4dcc-b2a3-7b79b19cbc7e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:32.498908 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ce924b45-a22e-4dcc-b2a3-7b79b19cbc7e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:32.499298 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ce924b45-a22e-4dcc-b2a3-7b79b19cbc7e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:32.550437 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4ea97da9-3ed0-4ede-be6e-b61fb92a735c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 6451 microversion: 2.20 time: 0.081110 Aug 13 04:35:32.551154 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 484/987] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:32 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 6451 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:35:32.570392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ce924b45-a22e-4dcc-b2a3-7b79b19cbc7e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 17508 microversion: 2.1 time: 0.084443 Aug 13 04:35:32.571110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 504/988] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:32 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 17508 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:33.563740 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7257a6e6-74f5-4555-a74f-74dd25346b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:33.564541 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7257a6e6-74f5-4555-a74f-74dd25346b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:33.571536 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7257a6e6-74f5-4555-a74f-74dd25346b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:33.572031 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7257a6e6-74f5-4555-a74f-74dd25346b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:33.572817 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7257a6e6-74f5-4555-a74f-74dd25346b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:33.573298 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7257a6e6-74f5-4555-a74f-74dd25346b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:33.583598 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e3b17ad3-871c-40ac-96d8-db25ff982ba5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:33.584644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e3b17ad3-871c-40ac-96d8-db25ff982ba5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:33.591326 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e3b17ad3-871c-40ac-96d8-db25ff982ba5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:33.591969 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e3b17ad3-871c-40ac-96d8-db25ff982ba5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:33.592625 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e3b17ad3-871c-40ac-96d8-db25ff982ba5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:33.593116 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e3b17ad3-871c-40ac-96d8-db25ff982ba5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:33.657056 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7257a6e6-74f5-4555-a74f-74dd25346b1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 13583 microversion: 2.20 time: 0.098219 Aug 13 04:35:33.660783 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 485/989] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:33 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 13583 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:33.669000 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e3b17ad3-871c-40ac-96d8-db25ff982ba5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 18083 microversion: 2.1 time: 0.089363 Aug 13 04:35:33.669739 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 505/990] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:33 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 18083 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:34.669272 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-90a42a0d-2ef7-4f7c-a31f-032b029cf118 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:34.671381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-90a42a0d-2ef7-4f7c-a31f-032b029cf118 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:34.677981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-90a42a0d-2ef7-4f7c-a31f-032b029cf118 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:34.678429 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-90a42a0d-2ef7-4f7c-a31f-032b029cf118 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:34.679196 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-90a42a0d-2ef7-4f7c-a31f-032b029cf118 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:34.679631 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-90a42a0d-2ef7-4f7c-a31f-032b029cf118 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:34.680069 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-37604bc5-4437-4b01-85b9-51f785256da8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:34.681028 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-37604bc5-4437-4b01-85b9-51f785256da8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:34.688304 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-37604bc5-4437-4b01-85b9-51f785256da8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:34.688745 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-37604bc5-4437-4b01-85b9-51f785256da8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:34.689535 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-37604bc5-4437-4b01-85b9-51f785256da8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:34.689967 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-37604bc5-4437-4b01-85b9-51f785256da8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:34.747179 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-90a42a0d-2ef7-4f7c-a31f-032b029cf118 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 18206 microversion: 2.20 time: 0.081928 Aug 13 04:35:34.747855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 486/991] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:34 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 18206 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:34.759311 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-37604bc5-4437-4b01-85b9-51f785256da8 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 19342 microversion: 2.1 time: 0.083103 Aug 13 04:35:34.760043 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 506/992] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:34 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 19342 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:35.760463 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9deec87b-ede4-4e3f-be08-f910eca37cf4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:35.761460 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9deec87b-ede4-4e3f-be08-f910eca37cf4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:35.768586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9deec87b-ede4-4e3f-be08-f910eca37cf4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:35.769050 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9deec87b-ede4-4e3f-be08-f910eca37cf4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:35.769847 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9deec87b-ede4-4e3f-be08-f910eca37cf4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:35.770409 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9deec87b-ede4-4e3f-be08-f910eca37cf4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:35.771429 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-87aa04b6-9b2c-43f7-8a25-5e0f742f1857 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:35.772491 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-87aa04b6-9b2c-43f7-8a25-5e0f742f1857 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:35.778901 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87aa04b6-9b2c-43f7-8a25-5e0f742f1857 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:35.780299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87aa04b6-9b2c-43f7-8a25-5e0f742f1857 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:35.780620 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87aa04b6-9b2c-43f7-8a25-5e0f742f1857 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:35.781057 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-87aa04b6-9b2c-43f7-8a25-5e0f742f1857 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:35.840108 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9deec87b-ede4-4e3f-be08-f910eca37cf4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 19133 microversion: 2.20 time: 0.083490 Aug 13 04:35:35.840761 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 487/993] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:35 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 19133 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:35.854619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-87aa04b6-9b2c-43f7-8a25-5e0f742f1857 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 22069 microversion: 2.1 time: 0.087083 Aug 13 04:35:35.855304 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 507/994] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:35 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 22069 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:36.852495 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a0bf4458-be81-44bb-bddb-925db5e8b2a5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:36.853512 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a0bf4458-be81-44bb-bddb-925db5e8b2a5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:36.860158 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a0bf4458-be81-44bb-bddb-925db5e8b2a5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:36.860608 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a0bf4458-be81-44bb-bddb-925db5e8b2a5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:36.861378 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a0bf4458-be81-44bb-bddb-925db5e8b2a5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:36.862128 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a0bf4458-be81-44bb-bddb-925db5e8b2a5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:36.867227 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-00438873-fee4-4431-a549-1bc1f4b28f0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:36.868230 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-00438873-fee4-4431-a549-1bc1f4b28f0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:36.874693 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00438873-fee4-4431-a549-1bc1f4b28f0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:36.875142 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00438873-fee4-4431-a549-1bc1f4b28f0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:36.875928 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00438873-fee4-4431-a549-1bc1f4b28f0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:36.876364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00438873-fee4-4431-a549-1bc1f4b28f0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:36.943369 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a0bf4458-be81-44bb-bddb-925db5e8b2a5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 21166 microversion: 2.20 time: 0.094725 Aug 13 04:35:36.944152 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 488/995] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:36 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 21166 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:36.969760 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-00438873-fee4-4431-a549-1bc1f4b28f0e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 23234 microversion: 2.1 time: 0.106442 Aug 13 04:35:36.970391 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 508/996] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:36 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 23234 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:37.955962 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8b89fb72-7d0a-4e24-8993-2def5b362900 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:37.956972 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8b89fb72-7d0a-4e24-8993-2def5b362900 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:37.963383 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8b89fb72-7d0a-4e24-8993-2def5b362900 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:37.963824 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8b89fb72-7d0a-4e24-8993-2def5b362900 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:37.964577 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8b89fb72-7d0a-4e24-8993-2def5b362900 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:37.965001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8b89fb72-7d0a-4e24-8993-2def5b362900 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:37.980525 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ba98ad80-1a4f-4b92-82ea-016536d2472d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:37.981642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ba98ad80-1a4f-4b92-82ea-016536d2472d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:37.988345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ba98ad80-1a4f-4b92-82ea-016536d2472d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:37.988795 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ba98ad80-1a4f-4b92-82ea-016536d2472d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:37.989615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ba98ad80-1a4f-4b92-82ea-016536d2472d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:37.990169 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ba98ad80-1a4f-4b92-82ea-016536d2472d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:40.940233 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8b89fb72-7d0a-4e24-8993-2def5b362900 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 25948 microversion: 2.20 time: 2.988627 Aug 13 04:35:40.941297 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 489/997] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:37 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 25948 bytes in 2990 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:40.962207 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ba98ad80-1a4f-4b92-82ea-016536d2472d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 27231 microversion: 2.1 time: 2.985446 Aug 13 04:35:40.962877 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 509/998] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:37 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 27231 bytes in 2987 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:41.952837 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4c56d41c-9daa-4303-b2e0-5e9211a50984 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:41.953988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4c56d41c-9daa-4303-b2e0-5e9211a50984 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:41.960563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4c56d41c-9daa-4303-b2e0-5e9211a50984 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:41.961008 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4c56d41c-9daa-4303-b2e0-5e9211a50984 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:41.961805 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4c56d41c-9daa-4303-b2e0-5e9211a50984 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:41.962239 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4c56d41c-9daa-4303-b2e0-5e9211a50984 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:41.974764 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-71c9d6de-d669-4a6b-b48c-85880cd6f3c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:41.975758 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-71c9d6de-d669-4a6b-b48c-85880cd6f3c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:41.983559 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-71c9d6de-d669-4a6b-b48c-85880cd6f3c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:41.984208 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-71c9d6de-d669-4a6b-b48c-85880cd6f3c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:41.985223 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-71c9d6de-d669-4a6b-b48c-85880cd6f3c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:41.985865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-71c9d6de-d669-4a6b-b48c-85880cd6f3c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:42.042373 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4c56d41c-9daa-4303-b2e0-5e9211a50984 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 26932 microversion: 2.20 time: 0.094038 Aug 13 04:35:42.043147 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 490/999] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:41 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 26932 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:42.063573 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-71c9d6de-d669-4a6b-b48c-85880cd6f3c6 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 27700 microversion: 2.1 time: 0.092492 Aug 13 04:35:42.064207 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 510/1000] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:41 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 27700 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:43.055592 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-cedf6a8b-4486-4b5b-807f-ded8284ca914 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:43.056499 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-cedf6a8b-4486-4b5b-807f-ded8284ca914 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:43.063729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cedf6a8b-4486-4b5b-807f-ded8284ca914 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:43.064179 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cedf6a8b-4486-4b5b-807f-ded8284ca914 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:43.064961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cedf6a8b-4486-4b5b-807f-ded8284ca914 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:43.065451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cedf6a8b-4486-4b5b-807f-ded8284ca914 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:43.075655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-715a1459-2f71-4b97-9619-f649d5b1bb87 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:43.077927 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-715a1459-2f71-4b97-9619-f649d5b1bb87 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:43.084810 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-715a1459-2f71-4b97-9619-f649d5b1bb87 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:43.085271 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-715a1459-2f71-4b97-9619-f649d5b1bb87 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:43.086214 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-715a1459-2f71-4b97-9619-f649d5b1bb87 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:43.086658 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-715a1459-2f71-4b97-9619-f649d5b1bb87 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:43.144056 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-cedf6a8b-4486-4b5b-807f-ded8284ca914 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 27559 microversion: 2.20 time: 0.092293 Aug 13 04:35:43.145153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 491/1001] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:43 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 27559 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:35:43.176501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-715a1459-2f71-4b97-9619-f649d5b1bb87 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 28080 microversion: 2.1 time: 0.104648 Aug 13 04:35:43.177182 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 511/1002] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:43 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 28080 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:35:44.157504 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f991f1ed-3e01-4bef-8980-d7d23a14e94e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:44.158509 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f991f1ed-3e01-4bef-8980-d7d23a14e94e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:44.165136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f991f1ed-3e01-4bef-8980-d7d23a14e94e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:44.165601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f991f1ed-3e01-4bef-8980-d7d23a14e94e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:44.166367 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f991f1ed-3e01-4bef-8980-d7d23a14e94e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:44.166797 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f991f1ed-3e01-4bef-8980-d7d23a14e94e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:44.190651 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ededd06d-462b-48cf-a6a1-15ad0ed30848 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:44.191659 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ededd06d-462b-48cf-a6a1-15ad0ed30848 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:44.198744 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ededd06d-462b-48cf-a6a1-15ad0ed30848 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:44.199265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ededd06d-462b-48cf-a6a1-15ad0ed30848 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:44.200274 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ededd06d-462b-48cf-a6a1-15ad0ed30848 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:44.200724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ededd06d-462b-48cf-a6a1-15ad0ed30848 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:44.240439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f991f1ed-3e01-4bef-8980-d7d23a14e94e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 27837 microversion: 2.20 time: 0.087922 Aug 13 04:35:44.241090 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 492/1003] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:44 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 27837 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:44.287785 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ededd06d-462b-48cf-a6a1-15ad0ed30848 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 28246 microversion: 2.1 time: 0.102412 Aug 13 04:35:44.288616 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 512/1004] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:44 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 28246 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:45.253124 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-88e91807-d1e4-4e4f-ba02-0327b6d2b9d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:45.254264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-88e91807-d1e4-4e4f-ba02-0327b6d2b9d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:45.260345 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-88e91807-d1e4-4e4f-ba02-0327b6d2b9d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:45.260789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-88e91807-d1e4-4e4f-ba02-0327b6d2b9d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:45.261586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-88e91807-d1e4-4e4f-ba02-0327b6d2b9d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:45.262020 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-88e91807-d1e4-4e4f-ba02-0327b6d2b9d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:45.300199 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3b16a9f1-e409-4d0b-a71c-9755ecfbc3d9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:45.301243 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3b16a9f1-e409-4d0b-a71c-9755ecfbc3d9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:45.307575 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b16a9f1-e409-4d0b-a71c-9755ecfbc3d9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:45.308026 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b16a9f1-e409-4d0b-a71c-9755ecfbc3d9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:45.308793 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b16a9f1-e409-4d0b-a71c-9755ecfbc3d9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:45.309224 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b16a9f1-e409-4d0b-a71c-9755ecfbc3d9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:45.327583 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-88e91807-d1e4-4e4f-ba02-0327b6d2b9d1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 28165 microversion: 2.20 time: 0.078924 Aug 13 04:35:45.328233 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 493/1005] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:45 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 28165 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:35:45.383102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3b16a9f1-e409-4d0b-a71c-9755ecfbc3d9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 28246 microversion: 2.1 time: 0.086698 Aug 13 04:35:45.383989 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 513/1006] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:45 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 28246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:35:46.340163 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d3e1a468-3cfb-455a-9490-9b99a1f7855b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:46.341158 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d3e1a468-3cfb-455a-9490-9b99a1f7855b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:46.348615 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d3e1a468-3cfb-455a-9490-9b99a1f7855b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:46.349156 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d3e1a468-3cfb-455a-9490-9b99a1f7855b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:46.350150 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d3e1a468-3cfb-455a-9490-9b99a1f7855b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:46.350658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d3e1a468-3cfb-455a-9490-9b99a1f7855b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:46.396315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9d8ca7fd-0136-467d-86bd-5b7dbc8313de tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:46.397329 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9d8ca7fd-0136-467d-86bd-5b7dbc8313de tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:46.403496 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9d8ca7fd-0136-467d-86bd-5b7dbc8313de tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:46.403938 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9d8ca7fd-0136-467d-86bd-5b7dbc8313de tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:46.404769 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9d8ca7fd-0136-467d-86bd-5b7dbc8313de tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:46.405199 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9d8ca7fd-0136-467d-86bd-5b7dbc8313de tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:46.425312 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d3e1a468-3cfb-455a-9490-9b99a1f7855b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 28165 microversion: 2.20 time: 0.089278 Aug 13 04:35:46.429733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 494/1007] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:46 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 28165 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:46.477509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9d8ca7fd-0136-467d-86bd-5b7dbc8313de tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 28537 microversion: 2.1 time: 0.085008 Aug 13 04:35:46.481365 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 514/1008] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:46 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 28537 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:47.438870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-144b2238-5647-4867-9857-b0b1fad67347 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:47.441791 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-144b2238-5647-4867-9857-b0b1fad67347 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:47.449295 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-144b2238-5647-4867-9857-b0b1fad67347 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:47.449851 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-144b2238-5647-4867-9857-b0b1fad67347 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:47.450631 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-144b2238-5647-4867-9857-b0b1fad67347 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:47.451069 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-144b2238-5647-4867-9857-b0b1fad67347 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:47.489975 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-04848eba-7812-4c1a-83fb-bb8bfb7118b4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:47.491115 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-04848eba-7812-4c1a-83fb-bb8bfb7118b4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:47.497820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04848eba-7812-4c1a-83fb-bb8bfb7118b4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:47.498937 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04848eba-7812-4c1a-83fb-bb8bfb7118b4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:47.500178 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04848eba-7812-4c1a-83fb-bb8bfb7118b4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:47.500635 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04848eba-7812-4c1a-83fb-bb8bfb7118b4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:47.520365 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-144b2238-5647-4867-9857-b0b1fad67347 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 28456 microversion: 2.20 time: 0.086544 Aug 13 04:35:47.521380 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 495/1009] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:47 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 28456 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:47.570905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-04848eba-7812-4c1a-83fb-bb8bfb7118b4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 28705 microversion: 2.1 time: 0.084406 Aug 13 04:35:47.572020 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 515/1010] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:47 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 28705 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:48.533609 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bf55145c-0de9-4c91-a348-65a915801a07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:48.534678 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bf55145c-0de9-4c91-a348-65a915801a07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:48.541502 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf55145c-0de9-4c91-a348-65a915801a07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:48.541963 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf55145c-0de9-4c91-a348-65a915801a07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:48.542750 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf55145c-0de9-4c91-a348-65a915801a07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:48.543186 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bf55145c-0de9-4c91-a348-65a915801a07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:48.587687 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6ec29acd-8903-4f2e-adf8-2a5fbca8e3e9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:48.588687 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6ec29acd-8903-4f2e-adf8-2a5fbca8e3e9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:48.596978 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ec29acd-8903-4f2e-adf8-2a5fbca8e3e9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:48.597450 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ec29acd-8903-4f2e-adf8-2a5fbca8e3e9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:48.598296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ec29acd-8903-4f2e-adf8-2a5fbca8e3e9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:48.598642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6ec29acd-8903-4f2e-adf8-2a5fbca8e3e9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:48.624610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bf55145c-0de9-4c91-a348-65a915801a07 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 28624 microversion: 2.20 time: 0.095757 Aug 13 04:35:48.626394 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 496/1011] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:48 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 28624 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:48.671983 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6ec29acd-8903-4f2e-adf8-2a5fbca8e3e9 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 28705 microversion: 2.1 time: 0.088541 Aug 13 04:35:48.673265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 516/1012] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:48 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 28705 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:35:49.638257 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2e0a62cf-56d1-4075-a6db-c95e7c41a72e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:49.640355 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2e0a62cf-56d1-4075-a6db-c95e7c41a72e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:49.647599 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e0a62cf-56d1-4075-a6db-c95e7c41a72e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:49.648224 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e0a62cf-56d1-4075-a6db-c95e7c41a72e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:49.649255 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e0a62cf-56d1-4075-a6db-c95e7c41a72e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:49.649834 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e0a62cf-56d1-4075-a6db-c95e7c41a72e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:49.684234 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1a191711-0c34-48ca-b3e5-325048ed7ab3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:49.685231 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1a191711-0c34-48ca-b3e5-325048ed7ab3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:49.693014 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a191711-0c34-48ca-b3e5-325048ed7ab3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:49.693486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a191711-0c34-48ca-b3e5-325048ed7ab3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:49.694474 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a191711-0c34-48ca-b3e5-325048ed7ab3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:49.695070 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1a191711-0c34-48ca-b3e5-325048ed7ab3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:49.722629 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2e0a62cf-56d1-4075-a6db-c95e7c41a72e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 28624 microversion: 2.20 time: 0.089843 Aug 13 04:35:49.726728 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 497/1013] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:49 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 28624 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:35:49.768316 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1a191711-0c34-48ca-b3e5-325048ed7ab3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 28705 microversion: 2.1 time: 0.087990 Aug 13 04:35:49.770509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 517/1014] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:49 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 28705 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:50.734947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b4826425-36f2-4123-99d1-76703b9554b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:50.736002 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b4826425-36f2-4123-99d1-76703b9554b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:50.742591 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4826425-36f2-4123-99d1-76703b9554b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:50.743037 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4826425-36f2-4123-99d1-76703b9554b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:50.743805 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4826425-36f2-4123-99d1-76703b9554b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:50.744239 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b4826425-36f2-4123-99d1-76703b9554b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:50.781265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-43d43015-81e8-4f05-90d8-ed5aa7e2cf86 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:50.782296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-43d43015-81e8-4f05-90d8-ed5aa7e2cf86 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:50.788707 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-43d43015-81e8-4f05-90d8-ed5aa7e2cf86 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:50.789154 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-43d43015-81e8-4f05-90d8-ed5aa7e2cf86 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:50.789959 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-43d43015-81e8-4f05-90d8-ed5aa7e2cf86 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:50.790394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-43d43015-81e8-4f05-90d8-ed5aa7e2cf86 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:50.812947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b4826425-36f2-4123-99d1-76703b9554b6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 28624 microversion: 2.20 time: 0.081885 Aug 13 04:35:50.816931 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 498/1015] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:50 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 28624 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:50.869869 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-43d43015-81e8-4f05-90d8-ed5aa7e2cf86 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 28705 microversion: 2.1 time: 0.093112 Aug 13 04:35:50.870509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 518/1016] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:50 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 28705 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:51.529040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-115230441", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "networks": [{"uuid": "333f6986-dcf0-4bcf-ad96-73e3f328f141"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:51.581028 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] validate_networks() for [('333f6986-dcf0-4bcf-ad96-73e3f328f141', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:35:51.824950 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-554e50c5-dea0-4f12-8259-bceacb6ba73c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:51.826673 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-554e50c5-dea0-4f12-8259-bceacb6ba73c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:51.833674 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-554e50c5-dea0-4f12-8259-bceacb6ba73c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:51.834214 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-554e50c5-dea0-4f12-8259-bceacb6ba73c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:51.835001 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-554e50c5-dea0-4f12-8259-bceacb6ba73c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:51.835441 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-554e50c5-dea0-4f12-8259-bceacb6ba73c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:51.903239 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-554e50c5-dea0-4f12-8259-bceacb6ba73c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 28624 microversion: 2.20 time: 0.082420 Aug 13 04:35:51.903885 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 519/1017] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:51 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 28624 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:35:51.909080 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5870cc0e-1016-4508-8fda-62303f0916b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:51.910246 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5870cc0e-1016-4508-8fda-62303f0916b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:51.916425 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5870cc0e-1016-4508-8fda-62303f0916b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:51.916874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5870cc0e-1016-4508-8fda-62303f0916b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:51.917705 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5870cc0e-1016-4508-8fda-62303f0916b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:51.918124 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5870cc0e-1016-4508-8fda-62303f0916b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:51.920291 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:35:51.920828 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:35:51.921264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:35:51.921721 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:35:51.922156 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:35:51.930819 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:51.931271 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:51.932080 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:51.933009 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:51.950341 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Getting quotas for project 3e4027fec5f84a06acc7277a243db1d0. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:35:51.954374 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Getting quotas for user 6cb64469c9124316acd8541f394b041a and project 3e4027fec5f84a06acc7277a243db1d0. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:35:51.965146 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:35:51.967661 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:35:51.990616 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5870cc0e-1016-4508-8fda-62303f0916b0 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 28720 microversion: 2.1 time: 0.085087 Aug 13 04:35:51.991302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 520/1018] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:51 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 28720 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:35:52.012174 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-58c49435-9bdf-4347-a734-6479499d3eb5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.487056 Aug 13 04:35:52.012820 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 499/1019] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:35:51 2021] POST /compute/v2.1/servers => generated 380 bytes in 489 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:35:52.023212 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c5441e47-4e4d-4743-876c-4c1f58e6de33 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:52.023905 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c5441e47-4e4d-4743-876c-4c1f58e6de33 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:52.080460 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c5441e47-4e4d-4743-876c-4c1f58e6de33 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:52.086874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c5441e47-4e4d-4743-876c-4c1f58e6de33 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1218 microversion: 2.1 time: 0.067666 Aug 13 04:35:52.087364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 521/1020] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:52 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:52.915458 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-51883c9f-601f-423a-ab2c-9725df34f10f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:52.916400 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-51883c9f-601f-423a-ab2c-9725df34f10f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:52.922622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-51883c9f-601f-423a-ab2c-9725df34f10f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:52.923203 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-51883c9f-601f-423a-ab2c-9725df34f10f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:52.923798 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-51883c9f-601f-423a-ab2c-9725df34f10f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:52.924224 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-51883c9f-601f-423a-ab2c-9725df34f10f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:52.992831 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-51883c9f-601f-423a-ab2c-9725df34f10f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 29245 microversion: 2.20 time: 0.081336 Aug 13 04:35:52.993533 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 500/1021] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:52 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 29245 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:53.002613 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-02eb0bbd-b535-460e-a513-560f83007024 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:53.003685 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-02eb0bbd-b535-460e-a513-560f83007024 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:53.010733 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02eb0bbd-b535-460e-a513-560f83007024 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:53.011180 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02eb0bbd-b535-460e-a513-560f83007024 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:53.011942 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02eb0bbd-b535-460e-a513-560f83007024 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:53.012371 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-02eb0bbd-b535-460e-a513-560f83007024 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:53.082758 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-02eb0bbd-b535-460e-a513-560f83007024 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 30292 microversion: 2.1 time: 0.084142 Aug 13 04:35:53.084365 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 522/1022] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:52 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 30292 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:35:53.104042 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-fdcf7685-d764-4e55-8686-81425a5583c9 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:53.105040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-fdcf7685-d764-4e55-8686-81425a5583c9 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:53.113263 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fdcf7685-d764-4e55-8686-81425a5583c9 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:53.114006 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fdcf7685-d764-4e55-8686-81425a5583c9 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:53.114802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fdcf7685-d764-4e55-8686-81425a5583c9 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:53.115242 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-fdcf7685-d764-4e55-8686-81425a5583c9 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:53.178243 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-fdcf7685-d764-4e55-8686-81425a5583c9 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:53.186202 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-fdcf7685-d764-4e55-8686-81425a5583c9 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1288 microversion: 2.1 time: 0.085849 Aug 13 04:35:53.186800 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 501/1023] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:53 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1288 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:54.005213 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d08815ba-f70e-421b-a972-c3f48bceee36 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:54.006365 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d08815ba-f70e-421b-a972-c3f48bceee36 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:54.012882 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d08815ba-f70e-421b-a972-c3f48bceee36 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:54.013415 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d08815ba-f70e-421b-a972-c3f48bceee36 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:54.014227 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d08815ba-f70e-421b-a972-c3f48bceee36 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:54.014668 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d08815ba-f70e-421b-a972-c3f48bceee36 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:54.093558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d08815ba-f70e-421b-a972-c3f48bceee36 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 30799 microversion: 2.20 time: 0.091965 Aug 13 04:35:54.094994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 523/1024] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:53 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 30799 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:54.096230 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a8d2a350-bd6e-4529-abd5-af6e556f728e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:54.097212 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a8d2a350-bd6e-4529-abd5-af6e556f728e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:54.103499 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8d2a350-bd6e-4529-abd5-af6e556f728e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:54.103945 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8d2a350-bd6e-4529-abd5-af6e556f728e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:54.104729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8d2a350-bd6e-4529-abd5-af6e556f728e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:54.105158 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8d2a350-bd6e-4529-abd5-af6e556f728e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:54.182565 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a8d2a350-bd6e-4529-abd5-af6e556f728e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 31786 microversion: 2.1 time: 0.090084 Aug 13 04:35:54.183577 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 502/1025] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:54 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 31786 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:35:54.206161 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-aadc63ed-19a8-4f03-b664-15ff8fb4525f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:54.206886 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-aadc63ed-19a8-4f03-b664-15ff8fb4525f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:54.213917 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aadc63ed-19a8-4f03-b664-15ff8fb4525f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:54.214359 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aadc63ed-19a8-4f03-b664-15ff8fb4525f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:54.215135 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aadc63ed-19a8-4f03-b664-15ff8fb4525f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:54.215569 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aadc63ed-19a8-4f03-b664-15ff8fb4525f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:54.340241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-aadc63ed-19a8-4f03-b664-15ff8fb4525f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:54.348267 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-aadc63ed-19a8-4f03-b664-15ff8fb4525f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1318 microversion: 2.1 time: 0.146338 Aug 13 04:35:54.348771 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 524/1026] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:54 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1318 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:54.721307 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-4c2f4b18-9f52-48b2-b89e-37cf41fa4b3a req-54dc11ba-f4aa-4345-a4ee-6a89e32b2f25 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fbe520d7-325b-4eb8-8a4b-f2708055fe56", "tag": "9e94bb8a-0301-4eda-b881-d66c4e39a5cd"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:54.722814 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:35:54.722814 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:35:54.729892 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-4c2f4b18-9f52-48b2-b89e-37cf41fa4b3a req-54dc11ba-f4aa-4345-a4ee-6a89e32b2f25 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:54.730326 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-4c2f4b18-9f52-48b2-b89e-37cf41fa4b3a req-54dc11ba-f4aa-4345-a4ee-6a89e32b2f25 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:54.742352 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-4c2f4b18-9f52-48b2-b89e-37cf41fa4b3a req-54dc11ba-f4aa-4345-a4ee-6a89e32b2f25 service nova] Creating event network-changed:9e94bb8a-0301-4eda-b881-d66c4e39a5cd for instance fbe520d7-325b-4eb8-8a4b-f2708055fe56 on hv-cinder-75996 Aug 13 04:35:54.746988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-4c2f4b18-9f52-48b2-b89e-37cf41fa4b3a req-54dc11ba-f4aa-4345-a4ee-6a89e32b2f25 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149180 Aug 13 04:35:54.747586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 503/1027] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:35:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:35:55.105317 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-aede1767-8796-44cd-ba06-b8bc0d5cc781 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:55.106338 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-aede1767-8796-44cd-ba06-b8bc0d5cc781 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:55.112221 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aede1767-8796-44cd-ba06-b8bc0d5cc781 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:55.112671 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aede1767-8796-44cd-ba06-b8bc0d5cc781 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:55.115230 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aede1767-8796-44cd-ba06-b8bc0d5cc781 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:55.115230 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aede1767-8796-44cd-ba06-b8bc0d5cc781 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:55.183513 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-aede1767-8796-44cd-ba06-b8bc0d5cc781 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 32307 microversion: 2.20 time: 0.081720 Aug 13 04:35:55.186908 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 525/1028] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:55 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 32307 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:55.196067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-08c9fdeb-2786-48f9-990b-c1553f2dfd1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:55.197066 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-08c9fdeb-2786-48f9-990b-c1553f2dfd1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:55.203196 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-08c9fdeb-2786-48f9-990b-c1553f2dfd1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:55.203641 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-08c9fdeb-2786-48f9-990b-c1553f2dfd1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:55.205526 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-08c9fdeb-2786-48f9-990b-c1553f2dfd1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:55.205962 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-08c9fdeb-2786-48f9-990b-c1553f2dfd1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:55.280633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-08c9fdeb-2786-48f9-990b-c1553f2dfd1d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 32614 microversion: 2.1 time: 0.088364 Aug 13 04:35:55.282130 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 504/1029] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:55 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 32614 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:35:55.366485 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-264e09fc-89e3-4fda-a52f-0fcf7bd731f0 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:55.367210 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-264e09fc-89e3-4fda-a52f-0fcf7bd731f0 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:55.373900 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-264e09fc-89e3-4fda-a52f-0fcf7bd731f0 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:55.374352 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-264e09fc-89e3-4fda-a52f-0fcf7bd731f0 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:55.375121 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-264e09fc-89e3-4fda-a52f-0fcf7bd731f0 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:55.376038 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-264e09fc-89e3-4fda-a52f-0fcf7bd731f0 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:55.499348 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-264e09fc-89e3-4fda-a52f-0fcf7bd731f0 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:55.507246 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-264e09fc-89e3-4fda-a52f-0fcf7bd731f0 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1318 microversion: 2.1 time: 0.144848 Aug 13 04:35:55.507814 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 526/1030] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:55 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1318 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:56.197664 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4374b92e-875a-4047-b027-361ec3d857f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:56.198651 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4374b92e-875a-4047-b027-361ec3d857f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:56.205444 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4374b92e-875a-4047-b027-361ec3d857f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:56.205903 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4374b92e-875a-4047-b027-361ec3d857f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:56.206678 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4374b92e-875a-4047-b027-361ec3d857f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:56.207114 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4374b92e-875a-4047-b027-361ec3d857f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:56.272465 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4374b92e-875a-4047-b027-361ec3d857f8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 33282 microversion: 2.20 time: 0.078707 Aug 13 04:35:56.273103 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 505/1031] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:56 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 33282 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:56.291856 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7eccaa43-a823-4dd2-b076-44b963bf08ef tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:56.292771 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7eccaa43-a823-4dd2-b076-44b963bf08ef tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:56.299154 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7eccaa43-a823-4dd2-b076-44b963bf08ef tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:56.299594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7eccaa43-a823-4dd2-b076-44b963bf08ef tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:56.300353 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7eccaa43-a823-4dd2-b076-44b963bf08ef tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:56.300790 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7eccaa43-a823-4dd2-b076-44b963bf08ef tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:56.367774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7eccaa43-a823-4dd2-b076-44b963bf08ef tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 33312 microversion: 2.1 time: 0.079384 Aug 13 04:35:56.368679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 527/1032] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:56 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 33312 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:35:56.524949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-20975ebd-4f69-4d00-8759-db43d69b3d2f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:56.525741 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-20975ebd-4f69-4d00-8759-db43d69b3d2f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:56.533643 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-20975ebd-4f69-4d00-8759-db43d69b3d2f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:56.534133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-20975ebd-4f69-4d00-8759-db43d69b3d2f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:56.534921 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-20975ebd-4f69-4d00-8759-db43d69b3d2f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:56.535360 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-20975ebd-4f69-4d00-8759-db43d69b3d2f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:56.659153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-20975ebd-4f69-4d00-8759-db43d69b3d2f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:56.666331 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-20975ebd-4f69-4d00-8759-db43d69b3d2f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1318 microversion: 2.1 time: 0.145791 Aug 13 04:35:56.666887 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 506/1033] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:56 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1318 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:57.284910 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2c19d9bd-039a-4e27-8da3-8530e4374a32 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:57.285921 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2c19d9bd-039a-4e27-8da3-8530e4374a32 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:57.293052 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2c19d9bd-039a-4e27-8da3-8530e4374a32 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:57.293665 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2c19d9bd-039a-4e27-8da3-8530e4374a32 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:57.294268 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2c19d9bd-039a-4e27-8da3-8530e4374a32 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:57.294696 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2c19d9bd-039a-4e27-8da3-8530e4374a32 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:57.366806 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2c19d9bd-039a-4e27-8da3-8530e4374a32 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 33990 microversion: 2.20 time: 0.085901 Aug 13 04:35:57.367419 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 528/1034] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:57 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 33990 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:57.380708 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0f9c31d4-b123-442d-9533-11748531d80d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:57.381687 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0f9c31d4-b123-442d-9533-11748531d80d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:57.387552 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0f9c31d4-b123-442d-9533-11748531d80d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:57.387998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0f9c31d4-b123-442d-9533-11748531d80d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:57.388760 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0f9c31d4-b123-442d-9533-11748531d80d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:57.389197 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0f9c31d4-b123-442d-9533-11748531d80d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:57.461223 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0f9c31d4-b123-442d-9533-11748531d80d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 34281 microversion: 2.1 time: 0.085065 Aug 13 04:35:57.461934 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 507/1035] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:57 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 34281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:35:57.684054 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-eb9e7ae9-ca86-4068-92f5-0593f8b066ed tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:57.684753 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-eb9e7ae9-ca86-4068-92f5-0593f8b066ed tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:57.691649 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb9e7ae9-ca86-4068-92f5-0593f8b066ed tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:57.692097 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb9e7ae9-ca86-4068-92f5-0593f8b066ed tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:57.692918 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb9e7ae9-ca86-4068-92f5-0593f8b066ed tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:57.693355 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eb9e7ae9-ca86-4068-92f5-0593f8b066ed tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:57.823912 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-eb9e7ae9-ca86-4068-92f5-0593f8b066ed tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:57.832293 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-eb9e7ae9-ca86-4068-92f5-0593f8b066ed tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1318 microversion: 2.1 time: 0.152264 Aug 13 04:35:57.832919 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 529/1036] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:57 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:58.378977 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-cde5b551-7274-4129-b252-b77256918ec1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:58.380016 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-cde5b551-7274-4129-b252-b77256918ec1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:58.386575 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cde5b551-7274-4129-b252-b77256918ec1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:58.387143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cde5b551-7274-4129-b252-b77256918ec1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:58.387781 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cde5b551-7274-4129-b252-b77256918ec1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:58.388216 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cde5b551-7274-4129-b252-b77256918ec1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:58.466988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-cde5b551-7274-4129-b252-b77256918ec1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 34983 microversion: 2.20 time: 0.092480 Aug 13 04:35:58.467627 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 508/1037] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:58 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 34983 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:58.473390 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-eda2bbd3-d657-4e30-984a-6a6d26cee7f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:58.474324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-eda2bbd3-d657-4e30-984a-6a6d26cee7f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:58.480214 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eda2bbd3-d657-4e30-984a-6a6d26cee7f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:58.480663 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eda2bbd3-d657-4e30-984a-6a6d26cee7f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:58.481447 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eda2bbd3-d657-4e30-984a-6a6d26cee7f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:58.481884 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-eda2bbd3-d657-4e30-984a-6a6d26cee7f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:58.548418 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-eda2bbd3-d657-4e30-984a-6a6d26cee7f3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 35425 microversion: 2.1 time: 0.078037 Aug 13 04:35:58.549042 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 530/1038] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:58 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 35425 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:35:58.849617 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-13619923-af62-4f93-822c-a2c9507c6686 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:35:58.850327 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-13619923-af62-4f93-822c-a2c9507c6686 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:58.856974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13619923-af62-4f93-822c-a2c9507c6686 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:58.857418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13619923-af62-4f93-822c-a2c9507c6686 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:58.858198 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13619923-af62-4f93-822c-a2c9507c6686 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:58.858627 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13619923-af62-4f93-822c-a2c9507c6686 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:58.980867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-13619923-af62-4f93-822c-a2c9507c6686 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:35:58.988693 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-13619923-af62-4f93-822c-a2c9507c6686 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1318 microversion: 2.1 time: 0.143261 Aug 13 04:35:58.989252 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 509/1039] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:35:58 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1318 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:35:59.479506 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-cb0b7fb2-ba5b-4f2e-8419-acbe306e2a63 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:59.480457 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-cb0b7fb2-ba5b-4f2e-8419-acbe306e2a63 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:59.487410 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cb0b7fb2-ba5b-4f2e-8419-acbe306e2a63 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:59.487862 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cb0b7fb2-ba5b-4f2e-8419-acbe306e2a63 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:59.488664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cb0b7fb2-ba5b-4f2e-8419-acbe306e2a63 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:59.489103 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-cb0b7fb2-ba5b-4f2e-8419-acbe306e2a63 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:59.553195 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-cb0b7fb2-ba5b-4f2e-8419-acbe306e2a63 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 35909 microversion: 2.20 time: 0.077666 Aug 13 04:35:59.554104 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 531/1040] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:35:59 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 35909 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:35:59.560199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-233e3f92-3dfa-4761-8318-9c2a3a9340fc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:35:59.561365 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-233e3f92-3dfa-4761-8318-9c2a3a9340fc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:35:59.567582 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-233e3f92-3dfa-4761-8318-9c2a3a9340fc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:59.568058 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-233e3f92-3dfa-4761-8318-9c2a3a9340fc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:59.568821 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-233e3f92-3dfa-4761-8318-9c2a3a9340fc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:35:59.569261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-233e3f92-3dfa-4761-8318-9c2a3a9340fc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:35:59.636260 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-233e3f92-3dfa-4761-8318-9c2a3a9340fc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 36536 microversion: 2.1 time: 0.079579 Aug 13 04:35:59.640351 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 510/1041] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:35:59 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 36536 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:36:00.007586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-06e44c31-b2d8-42c4-b035-fd5bd06f107a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:00.008283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-06e44c31-b2d8-42c4-b035-fd5bd06f107a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:00.014889 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-06e44c31-b2d8-42c4-b035-fd5bd06f107a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:00.015335 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-06e44c31-b2d8-42c4-b035-fd5bd06f107a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:00.016742 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-06e44c31-b2d8-42c4-b035-fd5bd06f107a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:00.017337 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-06e44c31-b2d8-42c4-b035-fd5bd06f107a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:00.144238 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-06e44c31-b2d8-42c4-b035-fd5bd06f107a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:00.151957 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-06e44c31-b2d8-42c4-b035-fd5bd06f107a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1318 microversion: 2.1 time: 0.149441 Aug 13 04:36:00.152522 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 532/1042] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:00 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:00.567259 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5bccc83c-24c0-491b-90f6-87a2efe06ee5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:00.568233 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5bccc83c-24c0-491b-90f6-87a2efe06ee5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:00.574856 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5bccc83c-24c0-491b-90f6-87a2efe06ee5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:00.575296 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5bccc83c-24c0-491b-90f6-87a2efe06ee5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:00.576056 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5bccc83c-24c0-491b-90f6-87a2efe06ee5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:00.576483 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5bccc83c-24c0-491b-90f6-87a2efe06ee5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:00.648026 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b5a520ee-2736-46eb-8731-0837c0336ca1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:00.648948 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b5a520ee-2736-46eb-8731-0837c0336ca1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:00.650012 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5bccc83c-24c0-491b-90f6-87a2efe06ee5 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 37126 microversion: 2.20 time: 0.086912 Aug 13 04:36:00.650998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 511/1043] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:36:00 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 37126 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:00.655079 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b5a520ee-2736-46eb-8731-0837c0336ca1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:00.655528 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b5a520ee-2736-46eb-8731-0837c0336ca1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:00.656307 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b5a520ee-2736-46eb-8731-0837c0336ca1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:00.657307 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b5a520ee-2736-46eb-8731-0837c0336ca1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:00.725741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b5a520ee-2736-46eb-8731-0837c0336ca1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 37625 microversion: 2.1 time: 0.081347 Aug 13 04:36:00.726382 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 533/1044] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:36:00 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 37625 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:36:01.168358 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c350e984-6786-4103-b8be-84abea887ce6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:01.169181 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c350e984-6786-4103-b8be-84abea887ce6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:01.176118 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c350e984-6786-4103-b8be-84abea887ce6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:01.176563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c350e984-6786-4103-b8be-84abea887ce6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:01.177329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c350e984-6786-4103-b8be-84abea887ce6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:01.177791 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c350e984-6786-4103-b8be-84abea887ce6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:01.309197 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c350e984-6786-4103-b8be-84abea887ce6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:01.317479 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c350e984-6786-4103-b8be-84abea887ce6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1318 microversion: 2.1 time: 0.153079 Aug 13 04:36:01.326278 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 512/1045] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:01 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:01.336087 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-a0a6e97d-496e-4107-a474-3add44f16f63 req-bc269cef-1425-4a29-bed3-5c104f976a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe520d7-325b-4eb8-8a4b-f2708055fe56", "name": "network-vif-plugged", "status": "completed", "tag": "9e94bb8a-0301-4eda-b881-d66c4e39a5cd"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:01.337520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:01.337520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:36:01.344636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-a0a6e97d-496e-4107-a474-3add44f16f63 req-bc269cef-1425-4a29-bed3-5c104f976a26 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:01.345083 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-a0a6e97d-496e-4107-a474-3add44f16f63 req-bc269cef-1425-4a29-bed3-5c104f976a26 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:01.355804 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-a0a6e97d-496e-4107-a474-3add44f16f63 req-bc269cef-1425-4a29-bed3-5c104f976a26 service nova] Creating event network-vif-plugged:9e94bb8a-0301-4eda-b881-d66c4e39a5cd for instance fbe520d7-325b-4eb8-8a4b-f2708055fe56 on hv-cinder-75996 Aug 13 04:36:01.360659 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-a0a6e97d-496e-4107-a474-3add44f16f63 req-bc269cef-1425-4a29-bed3-5c104f976a26 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.110136 Aug 13 04:36:01.361279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 534/1046] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:01 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:36:01.661901 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3c4ade91-c8b8-4d94-8da6-20c9bfe6221b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:01.662804 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3c4ade91-c8b8-4d94-8da6-20c9bfe6221b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:01.668586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3c4ade91-c8b8-4d94-8da6-20c9bfe6221b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:01.669025 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3c4ade91-c8b8-4d94-8da6-20c9bfe6221b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:01.669812 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3c4ade91-c8b8-4d94-8da6-20c9bfe6221b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:01.670234 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3c4ade91-c8b8-4d94-8da6-20c9bfe6221b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:01.738659 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-44ccb44e-7dbd-4144-8ecf-d283192125dc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:01.739638 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-44ccb44e-7dbd-4144-8ecf-d283192125dc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:01.745683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-44ccb44e-7dbd-4144-8ecf-d283192125dc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:01.746127 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-44ccb44e-7dbd-4144-8ecf-d283192125dc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:01.746881 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-44ccb44e-7dbd-4144-8ecf-d283192125dc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:01.747314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-44ccb44e-7dbd-4144-8ecf-d283192125dc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:01.755865 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3c4ade91-c8b8-4d94-8da6-20c9bfe6221b tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 38174 microversion: 2.20 time: 0.097449 Aug 13 04:36:01.760138 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 513/1047] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:36:01 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 38174 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:01.824644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-44ccb44e-7dbd-4144-8ecf-d283192125dc tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 38239 microversion: 2.1 time: 0.090545 Aug 13 04:36:01.825289 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 535/1048] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:36:01 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 38239 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Aug 13 04:36:02.052989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-46e9e36d-f84b-47d6-a172-37da2601c129 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-2077988141"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:02.053552 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-46e9e36d-f84b-47d6-a172-37da2601c129 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:02.060115 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-46e9e36d-f84b-47d6-a172-37da2601c129 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:02.060563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-46e9e36d-f84b-47d6-a172-37da2601c129 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:02.061609 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-46e9e36d-f84b-47d6-a172-37da2601c129 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:02.062044 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-46e9e36d-f84b-47d6-a172-37da2601c129 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:02.177515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.network.security_group_api [None req-46e9e36d-f84b-47d6-a172-37da2601c129 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Removing security group c232f22c-735e-48a8-92bd-6c9155256075 from port 90912158-5071-4e18-b5b5-6e2227fd5493 Aug 13 04:36:02.335085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-00fc5b56-1590-4df4-821c-76e127f586fc tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:02.335785 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-00fc5b56-1590-4df4-821c-76e127f586fc tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:02.342181 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00fc5b56-1590-4df4-821c-76e127f586fc tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:02.342627 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00fc5b56-1590-4df4-821c-76e127f586fc tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:02.343393 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00fc5b56-1590-4df4-821c-76e127f586fc tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:02.343826 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-00fc5b56-1590-4df4-821c-76e127f586fc tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:02.528738 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-00fc5b56-1590-4df4-821c-76e127f586fc tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:02.539669 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-00fc5b56-1590-4df4-821c-76e127f586fc tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1318 microversion: 2.1 time: 0.208493 Aug 13 04:36:02.540480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 536/1049] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:02 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1318 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:02.768321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5faee43c-b8d4-45e0-bebc-8876d379dcca tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:02.770057 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5faee43c-b8d4-45e0-bebc-8876d379dcca tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:02.776155 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5faee43c-b8d4-45e0-bebc-8876d379dcca tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:02.776599 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5faee43c-b8d4-45e0-bebc-8876d379dcca tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:02.777384 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5faee43c-b8d4-45e0-bebc-8876d379dcca tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:02.777851 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5faee43c-b8d4-45e0-bebc-8876d379dcca tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:02.847029 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5faee43c-b8d4-45e0-bebc-8876d379dcca tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 38174 microversion: 2.20 time: 0.082910 Aug 13 04:36:02.851501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 537/1050] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:36:02 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 38174 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:36:02.851880 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-46e9e36d-f84b-47d6-a172-37da2601c129 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "POST /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/action" status: 202 len: 0 microversion: 2.1 time: 0.799118 Aug 13 04:36:02.851880 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 514/1051] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:36:02 2021] POST /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/action => generated 0 bytes in 803 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:02.857722 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d2ef9e5a-48c0-47b0-b001-e0f2ae9858e1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:02.858787 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d2ef9e5a-48c0-47b0-b001-e0f2ae9858e1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:02.870294 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d2ef9e5a-48c0-47b0-b001-e0f2ae9858e1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:02.870736 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d2ef9e5a-48c0-47b0-b001-e0f2ae9858e1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:02.876784 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d2ef9e5a-48c0-47b0-b001-e0f2ae9858e1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:02.877693 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d2ef9e5a-48c0-47b0-b001-e0f2ae9858e1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:02.927200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-c459a15a-a98e-4bbe-bec0-ccd9c8780e12 req-96001bf3-5640-4a41-bb15-ff4edbaf0cee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da403df1-360d-41cf-86fd-0b09258785d0", "tag": "90912158-5071-4e18-b5b5-6e2227fd5493"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:02.928749 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:02.928749 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:36:02.936634 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-c459a15a-a98e-4bbe-bec0-ccd9c8780e12 req-96001bf3-5640-4a41-bb15-ff4edbaf0cee service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:02.937067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-c459a15a-a98e-4bbe-bec0-ccd9c8780e12 req-96001bf3-5640-4a41-bb15-ff4edbaf0cee service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:02.950645 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-c459a15a-a98e-4bbe-bec0-ccd9c8780e12 req-96001bf3-5640-4a41-bb15-ff4edbaf0cee service nova] Creating event network-changed:90912158-5071-4e18-b5b5-6e2227fd5493 for instance da403df1-360d-41cf-86fd-0b09258785d0 on hv-cinder-75996 Aug 13 04:36:02.956853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-c459a15a-a98e-4bbe-bec0-ccd9c8780e12 req-96001bf3-5640-4a41-bb15-ff4edbaf0cee service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102152 Aug 13 04:36:02.957793 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 515/1052] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:02 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:02.968453 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d2ef9e5a-48c0-47b0-b001-e0f2ae9858e1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 38239 microversion: 2.1 time: 0.119225 Aug 13 04:36:02.970575 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 538/1053] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:36:02 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 38239 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:36:03.557179 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-302d35e1-45e0-4538-8ed5-6460f56956e5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:03.557914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-302d35e1-45e0-4538-8ed5-6460f56956e5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:03.564896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-302d35e1-45e0-4538-8ed5-6460f56956e5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:03.565352 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-302d35e1-45e0-4538-8ed5-6460f56956e5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:03.566360 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-302d35e1-45e0-4538-8ed5-6460f56956e5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:03.566798 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-302d35e1-45e0-4538-8ed5-6460f56956e5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:03.816265 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-302d35e1-45e0-4538-8ed5-6460f56956e5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:03.824064 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-302d35e1-45e0-4538-8ed5-6460f56956e5 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1508 microversion: 2.1 time: 0.271831 Aug 13 04:36:03.824726 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 516/1054] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:03 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:03.860077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c9715dff-5b34-40c1-945c-b5c8d06a12e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:03.861085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c9715dff-5b34-40c1-945c-b5c8d06a12e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:03.868100 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c9715dff-5b34-40c1-945c-b5c8d06a12e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:03.869110 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c9715dff-5b34-40c1-945c-b5c8d06a12e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:03.869378 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c9715dff-5b34-40c1-945c-b5c8d06a12e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:03.869880 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c9715dff-5b34-40c1-945c-b5c8d06a12e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:03.946202 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c9715dff-5b34-40c1-945c-b5c8d06a12e2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 38174 microversion: 2.20 time: 0.090394 Aug 13 04:36:03.946864 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 539/1055] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:36:03 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 38174 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:03.980003 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e4bf9674-e5aa-4598-9ee2-c79dade20d52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:03.981105 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e4bf9674-e5aa-4598-9ee2-c79dade20d52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:03.987891 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e4bf9674-e5aa-4598-9ee2-c79dade20d52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:03.988333 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e4bf9674-e5aa-4598-9ee2-c79dade20d52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:03.989110 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e4bf9674-e5aa-4598-9ee2-c79dade20d52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:03.989622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e4bf9674-e5aa-4598-9ee2-c79dade20d52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:04.055868 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e4bf9674-e5aa-4598-9ee2-c79dade20d52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 38239 microversion: 2.1 time: 0.079272 Aug 13 04:36:04.060293 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 517/1056] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:36:03 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 38239 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:36:04.119172 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a5c23b3a-2bee-44b2-ba54-838e114b92c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:04.120202 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a5c23b3a-2bee-44b2-ba54-838e114b92c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:04.128203 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a5c23b3a-2bee-44b2-ba54-838e114b92c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:04.128780 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a5c23b3a-2bee-44b2-ba54-838e114b92c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:04.129636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a5c23b3a-2bee-44b2-ba54-838e114b92c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:04.130070 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a5c23b3a-2bee-44b2-ba54-838e114b92c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:04.228680 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-a5c23b3a-2bee-44b2-ba54-838e114b92c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lazy-loading 'services' on Instance uuid da403df1-360d-41cf-86fd-0b09258785d0 {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:36:04.311057 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a5c23b3a-2bee-44b2-ba54-838e114b92c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "DELETE /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/os-volume_attachments/ab36ff70-1d66-4184-9462-6784af8592eb" status: 202 len: 0 microversion: 2.1 time: 0.200059 Aug 13 04:36:04.312674 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 540/1057] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:36:04 2021] DELETE /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/os-volume_attachments/ab36ff70-1d66-4184-9462-6784af8592eb => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:04.327199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-17cb2a6a-6171-4f72-8841-5c592b6e21b5 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:04.328335 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-17cb2a6a-6171-4f72-8841-5c592b6e21b5 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:04.337711 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-17cb2a6a-6171-4f72-8841-5c592b6e21b5 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:04.338485 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-17cb2a6a-6171-4f72-8841-5c592b6e21b5 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:04.339415 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-17cb2a6a-6171-4f72-8841-5c592b6e21b5 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:04.339912 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-17cb2a6a-6171-4f72-8841-5c592b6e21b5 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:04.373915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-17cb2a6a-6171-4f72-8841-5c592b6e21b5 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056635 Aug 13 04:36:04.374724 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 518/1058] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:36:04 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:04.959086 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-edd5a7c1-5775-4ec1-ae9b-15168a513e6d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:04.960137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-edd5a7c1-5775-4ec1-ae9b-15168a513e6d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:04.972959 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-edd5a7c1-5775-4ec1-ae9b-15168a513e6d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:04.973741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-edd5a7c1-5775-4ec1-ae9b-15168a513e6d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:04.974718 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-edd5a7c1-5775-4ec1-ae9b-15168a513e6d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:04.975366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-edd5a7c1-5775-4ec1-ae9b-15168a513e6d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:04.975481 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-8aa5bda6-aacf-4245-b832-3653e371c9c6 req-fa63507d-2588-46e1-9daf-a958676fb01e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "da403df1-360d-41cf-86fd-0b09258785d0", "tag": "90912158-5071-4e18-b5b5-6e2227fd5493"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:04.977261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:04.977261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:36:04.987911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-8aa5bda6-aacf-4245-b832-3653e371c9c6 req-fa63507d-2588-46e1-9daf-a958676fb01e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:04.993654 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-8aa5bda6-aacf-4245-b832-3653e371c9c6 req-fa63507d-2588-46e1-9daf-a958676fb01e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.008778 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-8aa5bda6-aacf-4245-b832-3653e371c9c6 req-fa63507d-2588-46e1-9daf-a958676fb01e service nova] Creating event network-changed:90912158-5071-4e18-b5b5-6e2227fd5493 for instance da403df1-360d-41cf-86fd-0b09258785d0 on hv-cinder-75996 Aug 13 04:36:05.013935 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-8aa5bda6-aacf-4245-b832-3653e371c9c6 req-fa63507d-2588-46e1-9daf-a958676fb01e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045028 Aug 13 04:36:05.014613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 519/1059] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:04 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:36:05.058240 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-edd5a7c1-5775-4ec1-ae9b-15168a513e6d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 200 len: 38315 microversion: 2.20 time: 0.103121 Aug 13 04:36:05.059442 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 541/1060] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:36:04 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 38315 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:05.069877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d5d1fedf-6998-4c17-b121-610e1877fbf4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:05.071133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d5d1fedf-6998-4c17-b121-610e1877fbf4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:05.083223 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d5d1fedf-6998-4c17-b121-610e1877fbf4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:05.083777 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d5d1fedf-6998-4c17-b121-610e1877fbf4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.084576 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-facbcc33-6369-4049-aa74-8cc4d717c010 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:05.085492 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d5d1fedf-6998-4c17-b121-610e1877fbf4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:05.086156 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-facbcc33-6369-4049-aa74-8cc4d717c010 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:05.086665 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d5d1fedf-6998-4c17-b121-610e1877fbf4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.103187 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-facbcc33-6369-4049-aa74-8cc4d717c010 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:05.103641 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-facbcc33-6369-4049-aa74-8cc4d717c010 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.104429 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-facbcc33-6369-4049-aa74-8cc4d717c010 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:05.104866 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-facbcc33-6369-4049-aa74-8cc4d717c010 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.131751 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-facbcc33-6369-4049-aa74-8cc4d717c010 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/ips" status: 200 len: 149 microversion: 2.20 time: 0.057462 Aug 13 04:36:05.132657 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 542/1061] 10.222.0.13 () {60 vars in 1289 bytes} [Fri Aug 13 04:36:05 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/ips => generated 149 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:36:05.167774 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d5d1fedf-6998-4c17-b121-610e1877fbf4 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action" status: 200 len: 38369 microversion: 2.1 time: 0.102790 Aug 13 04:36:05.168710 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 520/1062] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:36:05 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/action => generated 38369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:36:05.179134 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-14331050-d29d-495c-b041-6432592eec65 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:05.179639 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-14331050-d29d-495c-b041-6432592eec65 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:05.190095 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14331050-d29d-495c-b041-6432592eec65 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:05.190557 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14331050-d29d-495c-b041-6432592eec65 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.191356 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14331050-d29d-495c-b041-6432592eec65 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:05.191803 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14331050-d29d-495c-b041-6432592eec65 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.217932 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-14331050-d29d-495c-b041-6432592eec65 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/ips" status: 200 len: 145 microversion: 2.1 time: 0.042701 Aug 13 04:36:05.218514 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 543/1063] 10.222.0.13 () {58 vars in 1248 bytes} [Fri Aug 13 04:36:05 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:05.393322 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7f6ab4e0-b65c-48f2-9825-9115b61fd2ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:05.396918 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7f6ab4e0-b65c-48f2-9825-9115b61fd2ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:05.421027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7f6ab4e0-b65c-48f2-9825-9115b61fd2ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:05.424823 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7f6ab4e0-b65c-48f2-9825-9115b61fd2ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.428126 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7f6ab4e0-b65c-48f2-9825-9115b61fd2ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:05.430508 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7f6ab4e0-b65c-48f2-9825-9115b61fd2ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.518455 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7f6ab4e0-b65c-48f2-9825-9115b61fd2ed tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.131973 Aug 13 04:36:05.519334 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 521/1064] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:36:05 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/os-volume_attachments => generated 25 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:36:05.530017 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9ebbbed4-3793-4e99-8bc2-42e11f7a441d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:05.530811 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9ebbbed4-3793-4e99-8bc2-42e11f7a441d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:05.537303 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ebbbed4-3793-4e99-8bc2-42e11f7a441d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:05.538001 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ebbbed4-3793-4e99-8bc2-42e11f7a441d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.538775 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ebbbed4-3793-4e99-8bc2-42e11f7a441d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:05.539363 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9ebbbed4-3793-4e99-8bc2-42e11f7a441d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:05.637705 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-9ebbbed4-3793-4e99-8bc2-42e11f7a441d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] HTTP exception thrown: Instance da403df1-360d-41cf-86fd-0b09258785d0 is not attached to volume ab36ff70-1d66-4184-9462-6784af8592eb Aug 13 04:36:05.638428 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9ebbbed4-3793-4e99-8bc2-42e11f7a441d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Returning 404 to user: Instance da403df1-360d-41cf-86fd-0b09258785d0 is not attached to volume ab36ff70-1d66-4184-9462-6784af8592eb {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:36:05.639592 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9ebbbed4-3793-4e99-8bc2-42e11f7a441d tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "DELETE /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/os-volume_attachments/ab36ff70-1d66-4184-9462-6784af8592eb" status: 404 len: 154 microversion: 2.1 time: 0.113557 Aug 13 04:36:05.640223 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 544/1065] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:36:05 2021] DELETE /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0/os-volume_attachments/ab36ff70-1d66-4184-9462-6784af8592eb => generated 154 bytes in 115 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:36:06.737204 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4f4fcf08-05fe-4ce4-9e18-e1649d4d5dd3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c000e7fb-d6c9-474b-91eb-c14bb4af060f"}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:06.738466 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4f4fcf08-05fe-4ce4-9e18-e1649d4d5dd3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:06.744815 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f4fcf08-05fe-4ce4-9e18-e1649d4d5dd3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:06.745271 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f4fcf08-05fe-4ce4-9e18-e1649d4d5dd3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:06.746081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f4fcf08-05fe-4ce4-9e18-e1649d4d5dd3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:06.746515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f4fcf08-05fe-4ce4-9e18-e1649d4d5dd3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:06.790599 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-440b3852-11c2-4525-8de8-ed0d8ebf72c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:06.791266 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-440b3852-11c2-4525-8de8-ed0d8ebf72c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:06.798240 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-440b3852-11c2-4525-8de8-ed0d8ebf72c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:06.798767 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-440b3852-11c2-4525-8de8-ed0d8ebf72c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:06.799622 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-440b3852-11c2-4525-8de8-ed0d8ebf72c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:06.800153 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-440b3852-11c2-4525-8de8-ed0d8ebf72c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:06.825685 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-440b3852-11c2-4525-8de8-ed0d8ebf72c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:36:06.910773 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-440b3852-11c2-4525-8de8-ed0d8ebf72c8 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "DELETE /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 204 len: 0 microversion: 2.1 time: 0.123401 Aug 13 04:36:06.911504 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 545/1066] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:36:06 2021] DELETE /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 13 04:36:06.922607 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-88bfce71-b8ef-4d33-9235-ece775c78658 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:06.923324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-88bfce71-b8ef-4d33-9235-ece775c78658 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:06.929560 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88bfce71-b8ef-4d33-9235-ece775c78658 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:06.930152 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88bfce71-b8ef-4d33-9235-ece775c78658 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:06.931284 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88bfce71-b8ef-4d33-9235-ece775c78658 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:06.931860 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-88bfce71-b8ef-4d33-9235-ece775c78658 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:06.999671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4f4fcf08-05fe-4ce4-9e18-e1649d4d5dd3 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.266978 Aug 13 04:36:07.000735 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 522/1067] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:36:06 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments => generated 194 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:07.086634 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-88bfce71-b8ef-4d33-9235-ece775c78658 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:07.095009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-88bfce71-b8ef-4d33-9235-ece775c78658 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1554 microversion: 2.1 time: 0.177292 Aug 13 04:36:07.095590 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 546/1068] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:06 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1554 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:08.113477 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9acd0aeb-1ded-43da-8b66-c5da9e2edab4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:08.114193 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9acd0aeb-1ded-43da-8b66-c5da9e2edab4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:08.121258 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9acd0aeb-1ded-43da-8b66-c5da9e2edab4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:08.121738 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9acd0aeb-1ded-43da-8b66-c5da9e2edab4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:08.122635 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9acd0aeb-1ded-43da-8b66-c5da9e2edab4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:08.123541 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9acd0aeb-1ded-43da-8b66-c5da9e2edab4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:08.249261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9acd0aeb-1ded-43da-8b66-c5da9e2edab4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:08.256950 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9acd0aeb-1ded-43da-8b66-c5da9e2edab4 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1554 microversion: 2.1 time: 0.148590 Aug 13 04:36:08.257539 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 523/1069] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:08 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1554 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:09.276774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c09ffb54-a63d-4255-9d0d-e11b2c32a243 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:09.277467 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c09ffb54-a63d-4255-9d0d-e11b2c32a243 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:09.283994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c09ffb54-a63d-4255-9d0d-e11b2c32a243 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:09.284527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c09ffb54-a63d-4255-9d0d-e11b2c32a243 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:09.285381 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c09ffb54-a63d-4255-9d0d-e11b2c32a243 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:09.285916 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c09ffb54-a63d-4255-9d0d-e11b2c32a243 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:09.411320 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c09ffb54-a63d-4255-9d0d-e11b2c32a243 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '576a9c2014d242ff8f25b3df690bb518', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41ff29303444fd0820593792b37e277', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:09.419122 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c09ffb54-a63d-4255-9d0d-e11b2c32a243 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 200 len: 1554 microversion: 2.1 time: 0.147075 Aug 13 04:36:09.419697 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 547/1070] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:09 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 1554 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:09.552864 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-b1d300c9-0603-4f25-936e-c225fe6c9ac6 req-4ef24017-4172-4974-8fe1-c4ed3227f442 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "da403df1-360d-41cf-86fd-0b09258785d0", "name": "network-vif-deleted", "tag": "90912158-5071-4e18-b5b5-6e2227fd5493"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:09.555084 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:09.555084 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:36:09.564873 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-b1d300c9-0603-4f25-936e-c225fe6c9ac6 req-4ef24017-4172-4974-8fe1-c4ed3227f442 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:09.565309 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-b1d300c9-0603-4f25-936e-c225fe6c9ac6 req-4ef24017-4172-4974-8fe1-c4ed3227f442 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:09.576807 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-b1d300c9-0603-4f25-936e-c225fe6c9ac6 req-4ef24017-4172-4974-8fe1-c4ed3227f442 service nova] Creating event network-vif-deleted:90912158-5071-4e18-b5b5-6e2227fd5493 for instance da403df1-360d-41cf-86fd-0b09258785d0 on hv-cinder-75996 Aug 13 04:36:09.581637 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-b1d300c9-0603-4f25-936e-c225fe6c9ac6 req-4ef24017-4172-4974-8fe1-c4ed3227f442 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032611 Aug 13 04:36:09.582317 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 524/1071] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:09 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:10.436929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3aec557b-5451-4ca1-9e8f-d15f9b028470 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:10.437512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3aec557b-5451-4ca1-9e8f-d15f9b028470 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] [instance: da403df1-360d-41cf-86fd-0b09258785d0] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:10.444148 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3aec557b-5451-4ca1-9e8f-d15f9b028470 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:10.444599 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3aec557b-5451-4ca1-9e8f-d15f9b028470 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:10.445402 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3aec557b-5451-4ca1-9e8f-d15f9b028470 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:10.445866 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3aec557b-5451-4ca1-9e8f-d15f9b028470 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:10.460874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-3aec557b-5451-4ca1-9e8f-d15f9b028470 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] HTTP exception thrown: Instance da403df1-360d-41cf-86fd-0b09258785d0 could not be found. Aug 13 04:36:10.461494 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3aec557b-5451-4ca1-9e8f-d15f9b028470 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Returning 404 to user: Instance da403df1-360d-41cf-86fd-0b09258785d0 could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:36:10.462356 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3aec557b-5451-4ca1-9e8f-d15f9b028470 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0" status: 404 len: 111 microversion: 2.1 time: 0.029535 Aug 13 04:36:10.462899 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 548/1072] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:10 2021] GET /compute/v2.1/servers/da403df1-360d-41cf-86fd-0b09258785d0 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:36:10.472043 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-deaea666-1dc2-4566-8a41-242622708191 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] Calling method '.version_select at 0x7fc46c5b0dc0>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:10.488942 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-deaea666-1dc2-4566-8a41-242622708191 tempest-TestMinimumBasicScenario-1194900546 tempest-TestMinimumBasicScenario-1194900546-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1628648224" status: 202 len: 0 microversion: 2.1 time: 0.021343 Aug 13 04:36:10.489521 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 525/1073] 10.222.0.13 () {58 vars in 1272 bytes} [Fri Aug 13 04:36:10 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1628648224 => generated 0 bytes in 23 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:14.578366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-77ff7d55-35d2-417d-b331-cc8137b17000 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:14.579466 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-77ff7d55-35d2-417d-b331-cc8137b17000 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:14.585540 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-77ff7d55-35d2-417d-b331-cc8137b17000 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:14.585988 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-77ff7d55-35d2-417d-b331-cc8137b17000 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:14.586760 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-77ff7d55-35d2-417d-b331-cc8137b17000 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:14.587192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-77ff7d55-35d2-417d-b331-cc8137b17000 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:14.620003 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-77ff7d55-35d2-417d-b331-cc8137b17000 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045639 Aug 13 04:36:14.620470 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 549/1074] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:36:14 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:14.631837 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-65d35c85-6507-4cfd-bb20-6ff3c60d39d7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:14.632517 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-65d35c85-6507-4cfd-bb20-6ff3c60d39d7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:14.640282 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-65d35c85-6507-4cfd-bb20-6ff3c60d39d7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:14.640815 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-65d35c85-6507-4cfd-bb20-6ff3c60d39d7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:14.641878 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-65d35c85-6507-4cfd-bb20-6ff3c60d39d7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:14.642311 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-65d35c85-6507-4cfd-bb20-6ff3c60d39d7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:14.674846 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-65d35c85-6507-4cfd-bb20-6ff3c60d39d7 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments/c000e7fb-d6c9-474b-91eb-c14bb4af060f" status: 200 len: 194 microversion: 2.1 time: 0.047461 Aug 13 04:36:14.675477 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 526/1075] 10.222.0.13 () {58 vars in 1413 bytes} [Fri Aug 13 04:36:14 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments/c000e7fb-d6c9-474b-91eb-c14bb4af060f => generated 194 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:16.030644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-54428070-bd64-467a-b82c-9f9555f84788 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92b4e637-c0d1-4e0d-a9ee-aa854fa1ed46"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:16.031797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-54428070-bd64-467a-b82c-9f9555f84788 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:16.043932 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-54428070-bd64-467a-b82c-9f9555f84788 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:16.044485 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-54428070-bd64-467a-b82c-9f9555f84788 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:16.045487 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-54428070-bd64-467a-b82c-9f9555f84788 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:16.045872 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-54428070-bd64-467a-b82c-9f9555f84788 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:16.310117 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-54428070-bd64-467a-b82c-9f9555f84788 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283284 Aug 13 04:36:16.311303 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 550/1076] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:36:16 2021] POST /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments => generated 194 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:17.346579 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0b860375-388c-4a78-b401-0c458953e896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:17.347724 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0b860375-388c-4a78-b401-0c458953e896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:17.360786 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0b860375-388c-4a78-b401-0c458953e896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:17.361908 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0b860375-388c-4a78-b401-0c458953e896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:17.362938 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0b860375-388c-4a78-b401-0c458953e896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:17.363879 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0b860375-388c-4a78-b401-0c458953e896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:17.393934 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-0b860375-388c-4a78-b401-0c458953e896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lazy-loading 'flavor' on Instance uuid 5ba719a9-61df-4d8d-99c1-907f97a80e8e {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:36:17.538556 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0b860375-388c-4a78-b401-0c458953e896 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "POST /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e/action" status: 202 len: 0 microversion: 2.1 time: 0.196368 Aug 13 04:36:17.539224 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 527/1077] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:36:17 2021] POST /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:17.551036 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f3b9f3a2-0236-4851-9e3d-dd51e8b3c418 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:17.552504 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f3b9f3a2-0236-4851-9e3d-dd51e8b3c418 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:17.560398 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f3b9f3a2-0236-4851-9e3d-dd51e8b3c418 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:17.561172 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f3b9f3a2-0236-4851-9e3d-dd51e8b3c418 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:17.562250 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f3b9f3a2-0236-4851-9e3d-dd51e8b3c418 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:17.563186 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f3b9f3a2-0236-4851-9e3d-dd51e8b3c418 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:17.750331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f3b9f3a2-0236-4851-9e3d-dd51e8b3c418 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:17.761917 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f3b9f3a2-0236-4851-9e3d-dd51e8b3c418 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.216555 Aug 13 04:36:17.762492 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 551/1078] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:17 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:18.780609 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a890b4b6-d8c6-4abb-bc51-6c56b7b712a0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:18.782405 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a890b4b6-d8c6-4abb-bc51-6c56b7b712a0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:18.788215 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a890b4b6-d8c6-4abb-bc51-6c56b7b712a0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:18.788660 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a890b4b6-d8c6-4abb-bc51-6c56b7b712a0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:18.789439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a890b4b6-d8c6-4abb-bc51-6c56b7b712a0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:18.789869 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a890b4b6-d8c6-4abb-bc51-6c56b7b712a0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:18.925164 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a890b4b6-d8c6-4abb-bc51-6c56b7b712a0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:18.932573 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a890b4b6-d8c6-4abb-bc51-6c56b7b712a0 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.155919 Aug 13 04:36:18.933150 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 528/1079] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:18 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:19.949774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4b65d7bb-c383-4478-9962-76f369ce2a24 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:19.950378 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4b65d7bb-c383-4478-9962-76f369ce2a24 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:19.956702 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4b65d7bb-c383-4478-9962-76f369ce2a24 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:19.957147 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4b65d7bb-c383-4478-9962-76f369ce2a24 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:19.957942 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4b65d7bb-c383-4478-9962-76f369ce2a24 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:19.958382 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4b65d7bb-c383-4478-9962-76f369ce2a24 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:20.079459 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4b65d7bb-c383-4478-9962-76f369ce2a24 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:20.086767 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4b65d7bb-c383-4478-9962-76f369ce2a24 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.140612 Aug 13 04:36:20.087307 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 552/1080] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:19 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:21.104086 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-410ce7fc-39b3-48f4-a8bf-a00b2bdb95c1 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:21.104732 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-410ce7fc-39b3-48f4-a8bf-a00b2bdb95c1 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:21.111230 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-410ce7fc-39b3-48f4-a8bf-a00b2bdb95c1 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:21.111684 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-410ce7fc-39b3-48f4-a8bf-a00b2bdb95c1 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:21.112456 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-410ce7fc-39b3-48f4-a8bf-a00b2bdb95c1 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:21.112894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-410ce7fc-39b3-48f4-a8bf-a00b2bdb95c1 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:21.230565 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-410ce7fc-39b3-48f4-a8bf-a00b2bdb95c1 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:21.238924 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-410ce7fc-39b3-48f4-a8bf-a00b2bdb95c1 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.138535 Aug 13 04:36:21.239496 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 529/1081] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:21 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:21.367715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-dcb53c98-7dd1-4bcd-bd48-da69d4b21968 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "97dae9c1-500a-45d6-a9d6-c287d732fc4f", "device": "/dev/sdb"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:21.369249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-dcb53c98-7dd1-4bcd-bd48-da69d4b21968 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:21.376376 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dcb53c98-7dd1-4bcd-bd48-da69d4b21968 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:21.376843 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dcb53c98-7dd1-4bcd-bd48-da69d4b21968 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:21.377638 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dcb53c98-7dd1-4bcd-bd48-da69d4b21968 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:21.378077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dcb53c98-7dd1-4bcd-bd48-da69d4b21968 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:21.603631 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dcb53c98-7dd1-4bcd-bd48-da69d4b21968 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "POST /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.239452 Aug 13 04:36:21.604236 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 553/1082] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:36:21 2021] POST /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56/os-volume_attachments => generated 194 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:22.256001 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0e967383-7094-41fe-a8bb-e86709215b83 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:22.256616 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0e967383-7094-41fe-a8bb-e86709215b83 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:22.262526 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0e967383-7094-41fe-a8bb-e86709215b83 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:22.262980 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0e967383-7094-41fe-a8bb-e86709215b83 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:22.263748 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0e967383-7094-41fe-a8bb-e86709215b83 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:22.264184 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0e967383-7094-41fe-a8bb-e86709215b83 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:22.389200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-0e967383-7094-41fe-a8bb-e86709215b83 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:22.397958 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0e967383-7094-41fe-a8bb-e86709215b83 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.145600 Aug 13 04:36:22.398534 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 530/1083] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:22 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:23.067598 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-aef96425-f929-42fa-a3c6-b89b45441e4c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:23.068241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-aef96425-f929-42fa-a3c6-b89b45441e4c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:23.075278 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aef96425-f929-42fa-a3c6-b89b45441e4c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:23.075707 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aef96425-f929-42fa-a3c6-b89b45441e4c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:23.076499 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aef96425-f929-42fa-a3c6-b89b45441e4c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:23.076927 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-aef96425-f929-42fa-a3c6-b89b45441e4c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:23.108482 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-aef96425-f929-42fa-a3c6-b89b45441e4c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lazy-loading 'flavor' on Instance uuid 15f3dbb4-dc66-4923-95f0-d53a986ebf82 {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:36:23.385122 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-aef96425-f929-42fa-a3c6-b89b45441e4c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 202 len: 0 microversion: 2.20 time: 0.322297 Aug 13 04:36:23.385786 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 554/1084] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:36:23 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 0 bytes in 324 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:36:23.394243 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5b846cf5-88f7-4189-af44-a1676cba7d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:23.394857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5b846cf5-88f7-4189-af44-a1676cba7d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:23.401107 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5b846cf5-88f7-4189-af44-a1676cba7d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:23.401741 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5b846cf5-88f7-4189-af44-a1676cba7d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:23.402557 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5b846cf5-88f7-4189-af44-a1676cba7d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:23.403014 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5b846cf5-88f7-4189-af44-a1676cba7d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:23.415422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-408e7d36-0183-4446-a9c8-c610c5432ca8 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:23.416622 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-408e7d36-0183-4446-a9c8-c610c5432ca8 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:23.424897 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-408e7d36-0183-4446-a9c8-c610c5432ca8 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:23.425366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-408e7d36-0183-4446-a9c8-c610c5432ca8 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:23.426196 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-408e7d36-0183-4446-a9c8-c610c5432ca8 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:23.426623 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-408e7d36-0183-4446-a9c8-c610c5432ca8 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:23.595969 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5b846cf5-88f7-4189-af44-a1676cba7d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:23.604621 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5b846cf5-88f7-4189-af44-a1676cba7d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:23.606197 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5b846cf5-88f7-4189-af44-a1676cba7d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:23.607591 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5b846cf5-88f7-4189-af44-a1676cba7d78 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.217625 Aug 13 04:36:23.608427 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 531/1085] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:23 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:23.614934 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-408e7d36-0183-4446-a9c8-c610c5432ca8 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:23.622880 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-408e7d36-0183-4446-a9c8-c610c5432ca8 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.211807 Aug 13 04:36:23.623471 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 555/1086] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:23 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:23.896905 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ee0a6887-d6ee-4153-91f5-aea9ae6b6c02 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:23.897906 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ee0a6887-d6ee-4153-91f5-aea9ae6b6c02 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:23.903812 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee0a6887-d6ee-4153-91f5-aea9ae6b6c02 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:23.904249 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee0a6887-d6ee-4153-91f5-aea9ae6b6c02 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:23.904997 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee0a6887-d6ee-4153-91f5-aea9ae6b6c02 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:23.905439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ee0a6887-d6ee-4153-91f5-aea9ae6b6c02 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:23.937136 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ee0a6887-d6ee-4153-91f5-aea9ae6b6c02 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044074 Aug 13 04:36:23.937727 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 532/1087] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:36:23 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:24.118803 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0caeec52-ba52-47b0-a9b0-8b7f38e3f3ab tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:24.119347 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0caeec52-ba52-47b0-a9b0-8b7f38e3f3ab tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:24.125488 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0caeec52-ba52-47b0-a9b0-8b7f38e3f3ab tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.126541 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0caeec52-ba52-47b0-a9b0-8b7f38e3f3ab tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.127332 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0caeec52-ba52-47b0-a9b0-8b7f38e3f3ab tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.127769 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0caeec52-ba52-47b0-a9b0-8b7f38e3f3ab tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.156036 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0caeec52-ba52-47b0-a9b0-8b7f38e3f3ab tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments/c000e7fb-d6c9-474b-91eb-c14bb4af060f" status: 200 len: 194 microversion: 2.1 time: 0.041844 Aug 13 04:36:24.156622 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 556/1088] 10.222.0.13 () {58 vars in 1413 bytes} [Fri Aug 13 04:36:24 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments/c000e7fb-d6c9-474b-91eb-c14bb4af060f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:24.166175 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a7be814e-19bb-47d5-a4a4-0406eea0630d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:24.166697 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a7be814e-19bb-47d5-a4a4-0406eea0630d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:24.173449 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7be814e-19bb-47d5-a4a4-0406eea0630d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.173934 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7be814e-19bb-47d5-a4a4-0406eea0630d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.174705 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7be814e-19bb-47d5-a4a4-0406eea0630d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.175141 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a7be814e-19bb-47d5-a4a4-0406eea0630d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.259148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-a7be814e-19bb-47d5-a4a4-0406eea0630d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lazy-loading 'services' on Instance uuid 8018e3b0-c3af-49a1-bbca-3123c9573244 {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:36:24.326067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a7be814e-19bb-47d5-a4a4-0406eea0630d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments/c000e7fb-d6c9-474b-91eb-c14bb4af060f" status: 202 len: 0 microversion: 2.1 time: 0.163566 Aug 13 04:36:24.326905 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 533/1089] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:36:24 2021] DELETE /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments/c000e7fb-d6c9-474b-91eb-c14bb4af060f => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:24.627198 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-afc3e60f-da86-4aca-8948-d54a2c05c5fb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:24.627588 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-afc3e60f-da86-4aca-8948-d54a2c05c5fb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:24.634410 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-afc3e60f-da86-4aca-8948-d54a2c05c5fb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.634963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-afc3e60f-da86-4aca-8948-d54a2c05c5fb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.635755 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-afc3e60f-da86-4aca-8948-d54a2c05c5fb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.636194 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-afc3e60f-da86-4aca-8948-d54a2c05c5fb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.641096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d57d2bf5-9795-4193-8792-03d58e24de57 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:24.642338 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d57d2bf5-9795-4193-8792-03d58e24de57 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:24.648343 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d57d2bf5-9795-4193-8792-03d58e24de57 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.648791 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d57d2bf5-9795-4193-8792-03d58e24de57 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.649687 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d57d2bf5-9795-4193-8792-03d58e24de57 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.650126 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d57d2bf5-9795-4193-8792-03d58e24de57 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.821019 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d57d2bf5-9795-4193-8792-03d58e24de57 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:24.826677 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-afc3e60f-da86-4aca-8948-d54a2c05c5fb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:24.828940 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d57d2bf5-9795-4193-8792-03d58e24de57 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.192370 Aug 13 04:36:24.829791 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 534/1090] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:24 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:24.837722 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-afc3e60f-da86-4aca-8948-d54a2c05c5fb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:24.837722 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-afc3e60f-da86-4aca-8948-d54a2c05c5fb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:24.838039 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-afc3e60f-da86-4aca-8948-d54a2c05c5fb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.214890 Aug 13 04:36:24.838777 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 557/1091] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:24 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:24.843281 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-dfc2c107-6764-4c4e-aeef-60cc9a61db63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:24.843801 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-dfc2c107-6764-4c4e-aeef-60cc9a61db63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:24.850332 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dfc2c107-6764-4c4e-aeef-60cc9a61db63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.850776 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dfc2c107-6764-4c4e-aeef-60cc9a61db63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.851534 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dfc2c107-6764-4c4e-aeef-60cc9a61db63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.851960 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dfc2c107-6764-4c4e-aeef-60cc9a61db63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.876502 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-dfc2c107-6764-4c4e-aeef-60cc9a61db63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Going to try to terminate instance {{(pid=108288) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:36:24.950909 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-dfc2c107-6764-4c4e-aeef-60cc9a61db63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 204 len: 0 microversion: 2.1 time: 0.111026 Aug 13 04:36:24.951398 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 535/1092] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:36:24 2021] DELETE /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 0 bytes in 113 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:36:24.960400 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-514ee51e-5bde-4e84-8693-5c3aa7fb8876 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:24.961192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-514ee51e-5bde-4e84-8693-5c3aa7fb8876 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:24.967909 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-514ee51e-5bde-4e84-8693-5c3aa7fb8876 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.968367 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-514ee51e-5bde-4e84-8693-5c3aa7fb8876 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:24.969150 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-514ee51e-5bde-4e84-8693-5c3aa7fb8876 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:24.970183 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-514ee51e-5bde-4e84-8693-5c3aa7fb8876 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:25.092901 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-514ee51e-5bde-4e84-8693-5c3aa7fb8876 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:25.101297 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-514ee51e-5bde-4e84-8693-5c3aa7fb8876 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1577 microversion: 2.1 time: 0.145004 Aug 13 04:36:25.101958 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 558/1093] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:24 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1577 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:25.846683 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-824ce219-bf3d-4355-96bf-c19f10e36939 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:25.847385 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-824ce219-bf3d-4355-96bf-c19f10e36939 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:25.853550 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-824ce219-bf3d-4355-96bf-c19f10e36939 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:25.854002 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-824ce219-bf3d-4355-96bf-c19f10e36939 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:25.855011 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-824ce219-bf3d-4355-96bf-c19f10e36939 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:25.855235 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-824ce219-bf3d-4355-96bf-c19f10e36939 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:25.855800 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-04af6ae4-1b6e-4b82-ae59-97fcf492647a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:25.856411 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-04af6ae4-1b6e-4b82-ae59-97fcf492647a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:25.862420 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04af6ae4-1b6e-4b82-ae59-97fcf492647a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:25.862860 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04af6ae4-1b6e-4b82-ae59-97fcf492647a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:25.863625 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04af6ae4-1b6e-4b82-ae59-97fcf492647a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:25.864053 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-04af6ae4-1b6e-4b82-ae59-97fcf492647a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:26.038827 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-824ce219-bf3d-4355-96bf-c19f10e36939 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:26.045863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-04af6ae4-1b6e-4b82-ae59-97fcf492647a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:26.046091 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-824ce219-bf3d-4355-96bf-c19f10e36939 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.203606 Aug 13 04:36:26.046670 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 536/1094] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:25 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:26.054636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-04af6ae4-1b6e-4b82-ae59-97fcf492647a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:26.056191 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-04af6ae4-1b6e-4b82-ae59-97fcf492647a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:26.057362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-04af6ae4-1b6e-4b82-ae59-97fcf492647a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.205352 Aug 13 04:36:26.057980 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 559/1095] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:25 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:36:26.119998 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1cd8230d-123d-4bd1-a7d7-fae0c1a32135 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:26.120587 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1cd8230d-123d-4bd1-a7d7-fae0c1a32135 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:26.127370 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1cd8230d-123d-4bd1-a7d7-fae0c1a32135 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:26.127813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1cd8230d-123d-4bd1-a7d7-fae0c1a32135 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:26.128592 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1cd8230d-123d-4bd1-a7d7-fae0c1a32135 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:26.129029 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1cd8230d-123d-4bd1-a7d7-fae0c1a32135 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:26.269622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1cd8230d-123d-4bd1-a7d7-fae0c1a32135 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:26.279066 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1cd8230d-123d-4bd1-a7d7-fae0c1a32135 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1577 microversion: 2.1 time: 0.163005 Aug 13 04:36:26.279643 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 537/1096] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:26 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1577 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:27.064323 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-14939541-d7e7-4df5-9d74-bc143faa708c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:27.065064 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-14939541-d7e7-4df5-9d74-bc143faa708c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:27.071302 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14939541-d7e7-4df5-9d74-bc143faa708c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:27.071856 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14939541-d7e7-4df5-9d74-bc143faa708c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:27.072901 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14939541-d7e7-4df5-9d74-bc143faa708c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:27.073354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-14939541-d7e7-4df5-9d74-bc143faa708c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:27.076006 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-07740458-fb6f-41aa-af8c-1b8b11336814 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:27.076675 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-07740458-fb6f-41aa-af8c-1b8b11336814 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:27.083739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-07740458-fb6f-41aa-af8c-1b8b11336814 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:27.084172 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-07740458-fb6f-41aa-af8c-1b8b11336814 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:27.085153 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-07740458-fb6f-41aa-af8c-1b8b11336814 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:27.085618 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-07740458-fb6f-41aa-af8c-1b8b11336814 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:27.265182 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-14939541-d7e7-4df5-9d74-bc143faa708c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:27.275833 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-07740458-fb6f-41aa-af8c-1b8b11336814 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:27.277079 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-14939541-d7e7-4df5-9d74-bc143faa708c tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.217215 Aug 13 04:36:27.277935 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 560/1097] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:27 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:27.285228 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-07740458-fb6f-41aa-af8c-1b8b11336814 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:27.286770 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-07740458-fb6f-41aa-af8c-1b8b11336814 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:27.287916 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-07740458-fb6f-41aa-af8c-1b8b11336814 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.215717 Aug 13 04:36:27.288473 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 538/1098] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:27 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:36:27.297658 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2e74cb86-0fb0-4282-813f-8ea77532103c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:27.298303 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2e74cb86-0fb0-4282-813f-8ea77532103c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:27.304839 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e74cb86-0fb0-4282-813f-8ea77532103c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:27.305283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e74cb86-0fb0-4282-813f-8ea77532103c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:27.306083 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e74cb86-0fb0-4282-813f-8ea77532103c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:27.306513 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e74cb86-0fb0-4282-813f-8ea77532103c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:27.432915 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2e74cb86-0fb0-4282-813f-8ea77532103c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:27.441332 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2e74cb86-0fb0-4282-813f-8ea77532103c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 200 len: 1577 microversion: 2.1 time: 0.147359 Aug 13 04:36:27.441857 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 561/1099] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:27 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:27.732399 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-0b2ddbf7-9b5f-4110-a0ac-63c1c2c20b0d req-3ab25cf1-1b78-4113-a44c-edc17d9592f7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "04e0099a-7c38-4609-a63f-fee3baa6db7a", "name": "network-vif-deleted", "tag": "a6019955-dfeb-42fd-bf68-d1fac8198ecb"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:27.734320 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:27.734320 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:36:27.742048 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-0b2ddbf7-9b5f-4110-a0ac-63c1c2c20b0d req-3ab25cf1-1b78-4113-a44c-edc17d9592f7 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:27.742498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-0b2ddbf7-9b5f-4110-a0ac-63c1c2c20b0d req-3ab25cf1-1b78-4113-a44c-edc17d9592f7 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:27.754863 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-0b2ddbf7-9b5f-4110-a0ac-63c1c2c20b0d req-3ab25cf1-1b78-4113-a44c-edc17d9592f7 service nova] Creating event network-vif-deleted:a6019955-dfeb-42fd-bf68-d1fac8198ecb for instance 04e0099a-7c38-4609-a63f-fee3baa6db7a on hv-cinder-75996 Aug 13 04:36:27.759789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-0b2ddbf7-9b5f-4110-a0ac-63c1c2c20b0d req-3ab25cf1-1b78-4113-a44c-edc17d9592f7 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031000 Aug 13 04:36:27.760381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 539/1100] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:27 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:28.294835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d81bfacf-00d0-4f5d-81b1-85d3150c374e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:28.295680 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d81bfacf-00d0-4f5d-81b1-85d3150c374e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:28.303143 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d81bfacf-00d0-4f5d-81b1-85d3150c374e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:28.303143 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d81bfacf-00d0-4f5d-81b1-85d3150c374e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:28.308504 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-79d6e05e-3158-4836-9b2f-06cbc33b51c0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:28.309393 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-79d6e05e-3158-4836-9b2f-06cbc33b51c0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:28.311774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d81bfacf-00d0-4f5d-81b1-85d3150c374e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:28.314025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d81bfacf-00d0-4f5d-81b1-85d3150c374e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:28.317541 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-79d6e05e-3158-4836-9b2f-06cbc33b51c0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:28.322207 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-79d6e05e-3158-4836-9b2f-06cbc33b51c0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:28.323094 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-79d6e05e-3158-4836-9b2f-06cbc33b51c0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:28.323749 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-79d6e05e-3158-4836-9b2f-06cbc33b51c0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:28.522280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d81bfacf-00d0-4f5d-81b1-85d3150c374e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:28.534664 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-79d6e05e-3158-4836-9b2f-06cbc33b51c0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:28.541734 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d81bfacf-00d0-4f5d-81b1-85d3150c374e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.250942 Aug 13 04:36:28.546628 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-79d6e05e-3158-4836-9b2f-06cbc33b51c0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:28.548366 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-79d6e05e-3158-4836-9b2f-06cbc33b51c0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:28.549836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-79d6e05e-3158-4836-9b2f-06cbc33b51c0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.245118 Aug 13 04:36:28.550110 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 540/1101] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:28 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:36:28.560242 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 562/1102] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:28 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:28.572265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-20479dc3-b9b7-49cd-8bdf-416acc478a63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:28.572265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-20479dc3-b9b7-49cd-8bdf-416acc478a63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:28.581695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20479dc3-b9b7-49cd-8bdf-416acc478a63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:28.582125 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20479dc3-b9b7-49cd-8bdf-416acc478a63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:28.582923 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20479dc3-b9b7-49cd-8bdf-416acc478a63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:28.583371 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20479dc3-b9b7-49cd-8bdf-416acc478a63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:28.604760 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-20479dc3-b9b7-49cd-8bdf-416acc478a63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] HTTP exception thrown: Instance 04e0099a-7c38-4609-a63f-fee3baa6db7a could not be found. Aug 13 04:36:28.605362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-20479dc3-b9b7-49cd-8bdf-416acc478a63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Returning 404 to user: Instance 04e0099a-7c38-4609-a63f-fee3baa6db7a could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:36:28.606253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-20479dc3-b9b7-49cd-8bdf-416acc478a63 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 404 len: 111 microversion: 2.1 time: 0.044701 Aug 13 04:36:28.606807 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 563/1103] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:28 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:36:28.713156 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1573820673", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1602395338", "security_groups": [{"name": "tempest-secgroup-smoke-2048961314"}], "block_device_mapping_v2": [{"uuid": "081b3f2b-6022-4bc9-854b-03a37dbec30f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87d3a17b-ea4d-435b-9c8e-36b4c38780d2"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:28.821378 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] validate_networks() for [('87d3a17b-ea4d-435b-9c8e-36b4c38780d2', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:36:29.210426 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:36:29.210853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:36:29.211369 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:36:29.211730 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:36:29.212143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:36:29.220854 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:29.221296 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:29.222159 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:29.222597 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:29.240947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Getting quotas for project 6f2d284955ea4d12b60ceba4f7a53e87. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:36:29.246280 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Getting quotas for user 3abce7098260457cad30873156a242d0 and project 6f2d284955ea4d12b60ceba4f7a53e87. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:36:29.311361 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:36:29.313621 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='081b3f2b-6022-4bc9-854b-03a37dbec30f',volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:36:29.439626 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a94cb8fd-91dd-4236-aadb-fd613121747a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.730227 Aug 13 04:36:29.440274 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 541/1104] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:36:28 2021] POST /compute/v2.1/servers => generated 406 bytes in 732 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:36:29.451092 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7908a21c-bc32-41d7-b856-eaefae257994 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:29.452781 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7908a21c-bc32-41d7-b856-eaefae257994 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:29.515046 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7908a21c-bc32-41d7-b856-eaefae257994 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:29.522599 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7908a21c-bc32-41d7-b856-eaefae257994 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1095 microversion: 2.1 time: 0.076115 Aug 13 04:36:29.523439 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 564/1105] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:29 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1095 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:29.567524 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f2ce42fc-5b3e-40a9-a4b8-9651846d4a81 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:29.569063 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-77bb6585-6a7e-456d-8a58-2538481f092c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:29.569322 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-77bb6585-6a7e-456d-8a58-2538481f092c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:29.573792 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f2ce42fc-5b3e-40a9-a4b8-9651846d4a81 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:29.576180 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-77bb6585-6a7e-456d-8a58-2538481f092c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:29.576635 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-77bb6585-6a7e-456d-8a58-2538481f092c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:29.577515 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-77bb6585-6a7e-456d-8a58-2538481f092c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:29.578156 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-77bb6585-6a7e-456d-8a58-2538481f092c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:29.584176 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2ce42fc-5b3e-40a9-a4b8-9651846d4a81 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:29.585455 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2ce42fc-5b3e-40a9-a4b8-9651846d4a81 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:29.586591 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2ce42fc-5b3e-40a9-a4b8-9651846d4a81 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:29.587131 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f2ce42fc-5b3e-40a9-a4b8-9651846d4a81 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:29.771376 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-77bb6585-6a7e-456d-8a58-2538481f092c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:29.775184 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f2ce42fc-5b3e-40a9-a4b8-9651846d4a81 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:29.783013 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-77bb6585-6a7e-456d-8a58-2538481f092c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:29.785417 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f2ce42fc-5b3e-40a9-a4b8-9651846d4a81 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.221525 Aug 13 04:36:29.785794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-77bb6585-6a7e-456d-8a58-2538481f092c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:29.787893 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-77bb6585-6a7e-456d-8a58-2538481f092c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.223341 Aug 13 04:36:29.788860 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 565/1106] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:29 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:29.799939 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 542/1107] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:29 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:30.539807 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f209c274-60f2-4de3-abfd-5943f69ef31f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:30.540492 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f209c274-60f2-4de3-abfd-5943f69ef31f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:30.547098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f209c274-60f2-4de3-abfd-5943f69ef31f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:30.548467 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f209c274-60f2-4de3-abfd-5943f69ef31f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:30.549508 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f209c274-60f2-4de3-abfd-5943f69ef31f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:30.550139 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f209c274-60f2-4de3-abfd-5943f69ef31f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:30.621305 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f209c274-60f2-4de3-abfd-5943f69ef31f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:30.634503 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f209c274-60f2-4de3-abfd-5943f69ef31f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1211 microversion: 2.1 time: 0.098330 Aug 13 04:36:30.635100 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 543/1108] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:30 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:30.802400 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0ab71218-89a8-4ebc-a50c-5dde1f7a1dda tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:30.803015 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0ab71218-89a8-4ebc-a50c-5dde1f7a1dda tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:30.808122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d0389b00-8dfc-4ff0-9728-3a08c03b667e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:30.808727 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d0389b00-8dfc-4ff0-9728-3a08c03b667e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:30.809268 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0ab71218-89a8-4ebc-a50c-5dde1f7a1dda tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:30.809757 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0ab71218-89a8-4ebc-a50c-5dde1f7a1dda tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:30.811067 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0ab71218-89a8-4ebc-a50c-5dde1f7a1dda tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:30.811504 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0ab71218-89a8-4ebc-a50c-5dde1f7a1dda tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:30.815769 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d0389b00-8dfc-4ff0-9728-3a08c03b667e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:30.816434 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d0389b00-8dfc-4ff0-9728-3a08c03b667e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:30.817224 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d0389b00-8dfc-4ff0-9728-3a08c03b667e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:30.817695 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d0389b00-8dfc-4ff0-9728-3a08c03b667e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:31.003429 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0ab71218-89a8-4ebc-a50c-5dde1f7a1dda tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:31.009632 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d0389b00-8dfc-4ff0-9728-3a08c03b667e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:31.012354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0ab71218-89a8-4ebc-a50c-5dde1f7a1dda tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1569 microversion: 2.1 time: 0.213713 Aug 13 04:36:31.019336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d0389b00-8dfc-4ff0-9728-3a08c03b667e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:31.019675 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 566/1109] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:30 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1569 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:31.021074 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d0389b00-8dfc-4ff0-9728-3a08c03b667e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:31.022363 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d0389b00-8dfc-4ff0-9728-3a08c03b667e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.218533 Aug 13 04:36:31.023012 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 544/1110] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:30 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:31.028993 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-68d90951-206d-4e5b-80a6-8ec2ecb65877 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:31.029692 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-68d90951-206d-4e5b-80a6-8ec2ecb65877 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:31.036056 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68d90951-206d-4e5b-80a6-8ec2ecb65877 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:31.036561 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68d90951-206d-4e5b-80a6-8ec2ecb65877 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:31.037325 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68d90951-206d-4e5b-80a6-8ec2ecb65877 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:31.037793 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-68d90951-206d-4e5b-80a6-8ec2ecb65877 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:31.116765 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-68d90951-206d-4e5b-80a6-8ec2ecb65877 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "POST /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e/action" status: 202 len: 0 microversion: 2.1 time: 0.091269 Aug 13 04:36:31.120492 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 567/1111] 10.222.0.13 () {60 vars in 1278 bytes} [Fri Aug 13 04:36:31 2021] POST /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Aug 13 04:36:31.125199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-00a5e12f-f3cc-43b3-946d-dfeee520ec55 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:31.125861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-00a5e12f-f3cc-43b3-946d-dfeee520ec55 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:31.134040 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-00a5e12f-f3cc-43b3-946d-dfeee520ec55 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:31.134628 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-00a5e12f-f3cc-43b3-946d-dfeee520ec55 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:31.135902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-00a5e12f-f3cc-43b3-946d-dfeee520ec55 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:31.136451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-00a5e12f-f3cc-43b3-946d-dfeee520ec55 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:31.270366 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-00a5e12f-f3cc-43b3-946d-dfeee520ec55 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:31.279647 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-00a5e12f-f3cc-43b3-946d-dfeee520ec55 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1577 microversion: 2.1 time: 0.157902 Aug 13 04:36:31.280492 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 545/1112] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:31 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:31.652115 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0f12b86d-030e-468e-a3e7-e734742a1ef9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:31.652728 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0f12b86d-030e-468e-a3e7-e734742a1ef9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:31.658805 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0f12b86d-030e-468e-a3e7-e734742a1ef9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:31.659252 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0f12b86d-030e-468e-a3e7-e734742a1ef9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:31.660036 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0f12b86d-030e-468e-a3e7-e734742a1ef9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:31.660500 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0f12b86d-030e-468e-a3e7-e734742a1ef9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:31.780412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-0f12b86d-030e-468e-a3e7-e734742a1ef9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:31.789544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0f12b86d-030e-468e-a3e7-e734742a1ef9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1279 microversion: 2.1 time: 0.141095 Aug 13 04:36:31.790120 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 568/1113] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:31 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1279 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:32.041521 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d3f4c81b-cd71-4125-b6fc-4bf96c5774d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:32.042095 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d3f4c81b-cd71-4125-b6fc-4bf96c5774d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:32.048418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d3f4c81b-cd71-4125-b6fc-4bf96c5774d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:32.048862 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d3f4c81b-cd71-4125-b6fc-4bf96c5774d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:32.049655 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d3f4c81b-cd71-4125-b6fc-4bf96c5774d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:32.050090 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d3f4c81b-cd71-4125-b6fc-4bf96c5774d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:32.171962 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d3f4c81b-cd71-4125-b6fc-4bf96c5774d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:32.180290 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d3f4c81b-cd71-4125-b6fc-4bf96c5774d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:32.181813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d3f4c81b-cd71-4125-b6fc-4bf96c5774d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:32.182972 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d3f4c81b-cd71-4125-b6fc-4bf96c5774d4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.145252 Aug 13 04:36:32.183525 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 546/1114] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:32 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:32.299791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7ec7678c-6c4a-4a4d-bb83-ac1bc5935c47 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:32.300320 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7ec7678c-6c4a-4a4d-bb83-ac1bc5935c47 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:32.306161 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ec7678c-6c4a-4a4d-bb83-ac1bc5935c47 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:32.306602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ec7678c-6c4a-4a4d-bb83-ac1bc5935c47 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:32.307359 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ec7678c-6c4a-4a4d-bb83-ac1bc5935c47 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:32.307789 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7ec7678c-6c4a-4a4d-bb83-ac1bc5935c47 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:32.427485 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7ec7678c-6c4a-4a4d-bb83-ac1bc5935c47 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:32.434887 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7ec7678c-6c4a-4a4d-bb83-ac1bc5935c47 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1577 microversion: 2.1 time: 0.139510 Aug 13 04:36:32.435706 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 569/1115] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:32 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1577 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:32.806097 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-dc9b3e37-bcaf-4913-b624-9c6e66710a66 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:32.806714 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-dc9b3e37-bcaf-4913-b624-9c6e66710a66 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:32.812987 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dc9b3e37-bcaf-4913-b624-9c6e66710a66 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:32.813491 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dc9b3e37-bcaf-4913-b624-9c6e66710a66 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:32.814237 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dc9b3e37-bcaf-4913-b624-9c6e66710a66 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:32.814680 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-dc9b3e37-bcaf-4913-b624-9c6e66710a66 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:32.937411 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-dc9b3e37-bcaf-4913-b624-9c6e66710a66 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:32.944904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-dc9b3e37-bcaf-4913-b624-9c6e66710a66 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1279 microversion: 2.1 time: 0.142502 Aug 13 04:36:32.945483 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 547/1116] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:32 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1279 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:33.201895 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c1a7c632-e3e5-4826-99ca-9f7c557c0052 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:33.202453 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c1a7c632-e3e5-4826-99ca-9f7c557c0052 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:33.208996 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1a7c632-e3e5-4826-99ca-9f7c557c0052 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:33.209475 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1a7c632-e3e5-4826-99ca-9f7c557c0052 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:33.210257 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1a7c632-e3e5-4826-99ca-9f7c557c0052 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:33.210695 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c1a7c632-e3e5-4826-99ca-9f7c557c0052 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:33.316519 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 13 04:36:33.317177 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: Fri Aug 13 04:36:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 (ip 10.222.0.13) !!! Aug 13 04:36:33.332364 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c1a7c632-e3e5-4826-99ca-9f7c557c0052 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:33.341998 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c1a7c632-e3e5-4826-99ca-9f7c557c0052 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:33.343496 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c1a7c632-e3e5-4826-99ca-9f7c557c0052 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:33.344672 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c1a7c632-e3e5-4826-99ca-9f7c557c0052 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.146612 Aug 13 04:36:33.345220 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 570/1117] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:33 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:33.451823 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-96d8df18-d568-413d-88d2-5db1de1de445 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:33.452521 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-96d8df18-d568-413d-88d2-5db1de1de445 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:33.458704 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-96d8df18-d568-413d-88d2-5db1de1de445 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:33.459150 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-96d8df18-d568-413d-88d2-5db1de1de445 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:33.459911 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-96d8df18-d568-413d-88d2-5db1de1de445 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:33.460345 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-96d8df18-d568-413d-88d2-5db1de1de445 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:33.587914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-96d8df18-d568-413d-88d2-5db1de1de445 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:33.595619 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-96d8df18-d568-413d-88d2-5db1de1de445 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1577 microversion: 2.1 time: 0.147399 Aug 13 04:36:33.596199 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 548/1118] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:33 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1577 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:33.962545 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d3ecc325-48b6-4218-9f41-2a3ce087a0c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:33.964362 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d3ecc325-48b6-4218-9f41-2a3ce087a0c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:33.972981 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d3ecc325-48b6-4218-9f41-2a3ce087a0c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:33.973464 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d3ecc325-48b6-4218-9f41-2a3ce087a0c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:33.974347 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d3ecc325-48b6-4218-9f41-2a3ce087a0c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:33.974795 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d3ecc325-48b6-4218-9f41-2a3ce087a0c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:34.005301 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-0b673d8a-b7b7-4fbc-8a2a-c740e59adf8e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:34.006641 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-0b673d8a-b7b7-4fbc-8a2a-c740e59adf8e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:34.024148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0b673d8a-b7b7-4fbc-8a2a-c740e59adf8e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:34.026203 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0b673d8a-b7b7-4fbc-8a2a-c740e59adf8e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:34.027316 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0b673d8a-b7b7-4fbc-8a2a-c740e59adf8e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:34.027989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-0b673d8a-b7b7-4fbc-8a2a-c740e59adf8e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:34.081380 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-0b673d8a-b7b7-4fbc-8a2a-c740e59adf8e tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments/92b4e637-c0d1-4e0d-a9ee-aa854fa1ed46" status: 200 len: 194 microversion: 2.1 time: 0.082613 Aug 13 04:36:34.082608 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 549/1119] 10.222.0.13 () {58 vars in 1413 bytes} [Fri Aug 13 04:36:33 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments/92b4e637-c0d1-4e0d-a9ee-aa854fa1ed46 => generated 194 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:36:34.095437 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c77b2b14-3bb4-4554-b51f-2f4b908b6275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:34.096016 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c77b2b14-3bb4-4554-b51f-2f4b908b6275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:34.103362 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c77b2b14-3bb4-4554-b51f-2f4b908b6275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:34.104344 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c77b2b14-3bb4-4554-b51f-2f4b908b6275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:34.105315 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c77b2b14-3bb4-4554-b51f-2f4b908b6275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:34.105946 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c77b2b14-3bb4-4554-b51f-2f4b908b6275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:34.151794 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d3ecc325-48b6-4218-9f41-2a3ce087a0c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:34.160186 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d3ecc325-48b6-4218-9f41-2a3ce087a0c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1279 microversion: 2.1 time: 0.202114 Aug 13 04:36:34.160785 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 571/1120] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:33 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1279 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:34.201235 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-9c00c45c-ecd3-483a-912f-0ab26c0fad41 req-0ecabd91-ac47-4456-a54c-45e948583493 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fee77a-c81e-400f-8a01-959a6d472e9c", "tag": "b09d6a5f-8290-4c39-852c-99ab3183d05c"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:34.203879 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:34.203879 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:36:34.224842 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-c77b2b14-3bb4-4554-b51f-2f4b908b6275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lazy-loading 'services' on Instance uuid 8018e3b0-c3af-49a1-bbca-3123c9573244 {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:36:34.225345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-9c00c45c-ecd3-483a-912f-0ab26c0fad41 req-0ecabd91-ac47-4456-a54c-45e948583493 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:34.225828 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-9c00c45c-ecd3-483a-912f-0ab26c0fad41 req-0ecabd91-ac47-4456-a54c-45e948583493 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:34.252462 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-9c00c45c-ecd3-483a-912f-0ab26c0fad41 req-0ecabd91-ac47-4456-a54c-45e948583493 service nova] Creating event network-changed:b09d6a5f-8290-4c39-852c-99ab3183d05c for instance 06fee77a-c81e-400f-8a01-959a6d472e9c on hv-cinder-75996 Aug 13 04:36:34.258043 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-9c00c45c-ecd3-483a-912f-0ab26c0fad41 req-0ecabd91-ac47-4456-a54c-45e948583493 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.062148 Aug 13 04:36:34.259296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 572/1121] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:34.330085 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c77b2b14-3bb4-4554-b51f-2f4b908b6275 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments/92b4e637-c0d1-4e0d-a9ee-aa854fa1ed46" status: 202 len: 0 microversion: 2.1 time: 0.240486 Aug 13 04:36:34.330941 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 550/1122] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:36:34 2021] DELETE /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments/92b4e637-c0d1-4e0d-a9ee-aa854fa1ed46 => generated 0 bytes in 243 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:34.367092 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-46b935bb-bd5d-4aa3-8135-a66b4808524d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:34.367796 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-46b935bb-bd5d-4aa3-8135-a66b4808524d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:34.384141 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46b935bb-bd5d-4aa3-8135-a66b4808524d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:34.384876 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46b935bb-bd5d-4aa3-8135-a66b4808524d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:34.385860 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46b935bb-bd5d-4aa3-8135-a66b4808524d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:34.386463 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-46b935bb-bd5d-4aa3-8135-a66b4808524d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:34.580849 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-46b935bb-bd5d-4aa3-8135-a66b4808524d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:34.589050 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-46b935bb-bd5d-4aa3-8135-a66b4808524d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:34.591412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-46b935bb-bd5d-4aa3-8135-a66b4808524d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:34.592636 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-46b935bb-bd5d-4aa3-8135-a66b4808524d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.233567 Aug 13 04:36:34.593764 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 573/1123] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:34 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:34.613100 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ca646440-718b-44f2-b9ec-d6a9d04b2b1e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:34.614913 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ca646440-718b-44f2-b9ec-d6a9d04b2b1e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:34.623221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ca646440-718b-44f2-b9ec-d6a9d04b2b1e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:34.624441 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ca646440-718b-44f2-b9ec-d6a9d04b2b1e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:34.625343 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ca646440-718b-44f2-b9ec-d6a9d04b2b1e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:34.625802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ca646440-718b-44f2-b9ec-d6a9d04b2b1e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:34.775842 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ca646440-718b-44f2-b9ec-d6a9d04b2b1e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:34.784695 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ca646440-718b-44f2-b9ec-d6a9d04b2b1e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1519 microversion: 2.1 time: 0.176313 Aug 13 04:36:34.785273 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 551/1124] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:34 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1519 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:35.176786 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-172ab09a-3572-4344-8061-eb18ad7c934c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:35.177306 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-172ab09a-3572-4344-8061-eb18ad7c934c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:35.183283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-172ab09a-3572-4344-8061-eb18ad7c934c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:35.183733 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-172ab09a-3572-4344-8061-eb18ad7c934c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:35.184501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-172ab09a-3572-4344-8061-eb18ad7c934c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:35.184938 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-172ab09a-3572-4344-8061-eb18ad7c934c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:35.304399 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-172ab09a-3572-4344-8061-eb18ad7c934c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:35.311778 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-172ab09a-3572-4344-8061-eb18ad7c934c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.138809 Aug 13 04:36:35.312336 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 574/1125] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:35 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:35.611906 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d2154bbb-d591-4f5f-9d45-8fb5c53e7026 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:35.612556 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d2154bbb-d591-4f5f-9d45-8fb5c53e7026 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:35.618474 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d2154bbb-d591-4f5f-9d45-8fb5c53e7026 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:35.619119 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d2154bbb-d591-4f5f-9d45-8fb5c53e7026 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:35.619673 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d2154bbb-d591-4f5f-9d45-8fb5c53e7026 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:35.620117 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d2154bbb-d591-4f5f-9d45-8fb5c53e7026 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:35.741601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d2154bbb-d591-4f5f-9d45-8fb5c53e7026 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:35.749547 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d2154bbb-d591-4f5f-9d45-8fb5c53e7026 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:35.751921 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d2154bbb-d591-4f5f-9d45-8fb5c53e7026 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:35.753065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d2154bbb-d591-4f5f-9d45-8fb5c53e7026 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.145078 Aug 13 04:36:35.753653 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 552/1126] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:35 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:35.802414 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3f4e92fd-e375-4982-b2fa-ed1d78532c5b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:35.803118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3f4e92fd-e375-4982-b2fa-ed1d78532c5b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:35.809087 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f4e92fd-e375-4982-b2fa-ed1d78532c5b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:35.809573 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f4e92fd-e375-4982-b2fa-ed1d78532c5b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:35.810600 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f4e92fd-e375-4982-b2fa-ed1d78532c5b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:35.811037 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f4e92fd-e375-4982-b2fa-ed1d78532c5b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:35.933814 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3f4e92fd-e375-4982-b2fa-ed1d78532c5b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:35.942265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3f4e92fd-e375-4982-b2fa-ed1d78532c5b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1519 microversion: 2.1 time: 0.143536 Aug 13 04:36:35.942830 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 575/1127] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:35 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1519 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:36.328914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a861e906-9699-43bf-ad61-0cbdd60f7b24 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:36.329599 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a861e906-9699-43bf-ad61-0cbdd60f7b24 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:36.335650 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a861e906-9699-43bf-ad61-0cbdd60f7b24 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:36.336098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a861e906-9699-43bf-ad61-0cbdd60f7b24 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:36.336868 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a861e906-9699-43bf-ad61-0cbdd60f7b24 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:36.337308 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a861e906-9699-43bf-ad61-0cbdd60f7b24 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:36.454925 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a861e906-9699-43bf-ad61-0cbdd60f7b24 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:36.462354 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a861e906-9699-43bf-ad61-0cbdd60f7b24 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.137143 Aug 13 04:36:36.462914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 553/1128] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:36 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:36.771165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2e0831ba-4ad5-49b8-b29d-9f40d0239692 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:36.771780 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-2e0831ba-4ad5-49b8-b29d-9f40d0239692 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:36.777820 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e0831ba-4ad5-49b8-b29d-9f40d0239692 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:36.778122 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e0831ba-4ad5-49b8-b29d-9f40d0239692 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:36.778878 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e0831ba-4ad5-49b8-b29d-9f40d0239692 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:36.779314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-2e0831ba-4ad5-49b8-b29d-9f40d0239692 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:36.900451 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2e0831ba-4ad5-49b8-b29d-9f40d0239692 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:36.908155 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2e0831ba-4ad5-49b8-b29d-9f40d0239692 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:36.909689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-2e0831ba-4ad5-49b8-b29d-9f40d0239692 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:36.910822 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2e0831ba-4ad5-49b8-b29d-9f40d0239692 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.143358 Aug 13 04:36:36.911372 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 576/1129] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:36 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:36.958222 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-13a0c22f-1dce-459e-bd1c-f5e435620715 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:36.958836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-13a0c22f-1dce-459e-bd1c-f5e435620715 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:36.964732 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13a0c22f-1dce-459e-bd1c-f5e435620715 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:36.965183 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13a0c22f-1dce-459e-bd1c-f5e435620715 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:36.965985 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13a0c22f-1dce-459e-bd1c-f5e435620715 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:36.966425 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-13a0c22f-1dce-459e-bd1c-f5e435620715 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:37.089744 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-13a0c22f-1dce-459e-bd1c-f5e435620715 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:37.097252 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-13a0c22f-1dce-459e-bd1c-f5e435620715 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1519 microversion: 2.1 time: 0.142639 Aug 13 04:36:37.097843 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 554/1130] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:36 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1519 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:37.478883 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-85c1f3a8-9764-45d4-9057-97dcb8aa90ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:37.479499 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-85c1f3a8-9764-45d4-9057-97dcb8aa90ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:37.487234 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85c1f3a8-9764-45d4-9057-97dcb8aa90ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:37.487681 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85c1f3a8-9764-45d4-9057-97dcb8aa90ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:37.488443 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85c1f3a8-9764-45d4-9057-97dcb8aa90ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:37.488879 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-85c1f3a8-9764-45d4-9057-97dcb8aa90ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:37.624051 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-85c1f3a8-9764-45d4-9057-97dcb8aa90ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:37.631955 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-85c1f3a8-9764-45d4-9057-97dcb8aa90ec tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.156652 Aug 13 04:36:37.632543 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 577/1131] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:37 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:37.928806 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-733ef8e3-7aa0-4685-af28-259b47f2534a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:37.929410 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-733ef8e3-7aa0-4685-af28-259b47f2534a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:37.935469 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-733ef8e3-7aa0-4685-af28-259b47f2534a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:37.935922 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-733ef8e3-7aa0-4685-af28-259b47f2534a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:37.936668 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-733ef8e3-7aa0-4685-af28-259b47f2534a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:37.937092 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-733ef8e3-7aa0-4685-af28-259b47f2534a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:38.077733 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-733ef8e3-7aa0-4685-af28-259b47f2534a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:38.087717 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-733ef8e3-7aa0-4685-af28-259b47f2534a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:38.089515 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-733ef8e3-7aa0-4685-af28-259b47f2534a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:38.090881 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-733ef8e3-7aa0-4685-af28-259b47f2534a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.165807 Aug 13 04:36:38.102092 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 555/1132] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:37 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:38.113564 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b40beeb9-7f98-4540-8413-6c7438014e07 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:38.116065 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b40beeb9-7f98-4540-8413-6c7438014e07 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:38.127502 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b40beeb9-7f98-4540-8413-6c7438014e07 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:38.128249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b40beeb9-7f98-4540-8413-6c7438014e07 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:38.129036 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b40beeb9-7f98-4540-8413-6c7438014e07 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:38.129707 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b40beeb9-7f98-4540-8413-6c7438014e07 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:38.178717 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-dc83ecdf-f0c3-4b4a-b203-ce53c9bc5948 req-a8259a9e-2ffa-422d-bba0-816f0bcb597e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba719a9-61df-4d8d-99c1-907f97a80e8e", "name": "network-vif-unplugged", "status": "completed", "tag": "1166ab58-4fa6-49a1-b301-c03b411d9dc0"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:38.180923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:38.180923 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:36:38.190091 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-dc83ecdf-f0c3-4b4a-b203-ce53c9bc5948 req-a8259a9e-2ffa-422d-bba0-816f0bcb597e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:38.190980 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-dc83ecdf-f0c3-4b4a-b203-ce53c9bc5948 req-a8259a9e-2ffa-422d-bba0-816f0bcb597e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:38.205668 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-dc83ecdf-f0c3-4b4a-b203-ce53c9bc5948 req-a8259a9e-2ffa-422d-bba0-816f0bcb597e service nova] Creating event network-vif-unplugged:1166ab58-4fa6-49a1-b301-c03b411d9dc0 for instance 5ba719a9-61df-4d8d-99c1-907f97a80e8e on hv-cinder-75996 Aug 13 04:36:38.211005 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-dc83ecdf-f0c3-4b4a-b203-ce53c9bc5948 req-a8259a9e-2ffa-422d-bba0-816f0bcb597e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.035799 Aug 13 04:36:38.212272 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 556/1133] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:38 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:38.275339 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b40beeb9-7f98-4540-8413-6c7438014e07 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:38.283648 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b40beeb9-7f98-4540-8413-6c7438014e07 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.173975 Aug 13 04:36:38.284382 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 578/1134] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:38 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:38.649671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8759ca49-daf8-46a5-8221-2dcb45d092a6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:38.650370 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8759ca49-daf8-46a5-8221-2dcb45d092a6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:38.656611 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8759ca49-daf8-46a5-8221-2dcb45d092a6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:38.657197 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8759ca49-daf8-46a5-8221-2dcb45d092a6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:38.658002 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8759ca49-daf8-46a5-8221-2dcb45d092a6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:38.658429 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8759ca49-daf8-46a5-8221-2dcb45d092a6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:38.795870 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-8759ca49-daf8-46a5-8221-2dcb45d092a6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:38.804027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8759ca49-daf8-46a5-8221-2dcb45d092a6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.158320 Aug 13 04:36:38.804605 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 557/1135] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:38 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:39.110832 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b0f0a995-c95d-4f4d-8967-1f068a2706a3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:39.111561 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b0f0a995-c95d-4f4d-8967-1f068a2706a3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:39.117461 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b0f0a995-c95d-4f4d-8967-1f068a2706a3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:39.118056 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b0f0a995-c95d-4f4d-8967-1f068a2706a3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:39.118665 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b0f0a995-c95d-4f4d-8967-1f068a2706a3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:39.119088 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b0f0a995-c95d-4f4d-8967-1f068a2706a3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:39.244966 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b0f0a995-c95d-4f4d-8967-1f068a2706a3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:39.253078 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b0f0a995-c95d-4f4d-8967-1f068a2706a3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:39.254597 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b0f0a995-c95d-4f4d-8967-1f068a2706a3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:39.255725 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b0f0a995-c95d-4f4d-8967-1f068a2706a3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.149817 Aug 13 04:36:39.256273 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 579/1136] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:39 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:39.300522 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e0c56256-4a62-422d-91bb-cf33990a8dbe tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:39.301170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e0c56256-4a62-422d-91bb-cf33990a8dbe tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:39.307081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e0c56256-4a62-422d-91bb-cf33990a8dbe tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:39.307529 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e0c56256-4a62-422d-91bb-cf33990a8dbe tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:39.308295 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e0c56256-4a62-422d-91bb-cf33990a8dbe tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:39.308780 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e0c56256-4a62-422d-91bb-cf33990a8dbe tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:39.430598 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e0c56256-4a62-422d-91bb-cf33990a8dbe tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:39.438148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e0c56256-4a62-422d-91bb-cf33990a8dbe tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.142017 Aug 13 04:36:39.438717 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 558/1137] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:39 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:39.764077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-bd19af7b-e503-42b6-8d98-e48ccc516174 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:39.765074 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-bd19af7b-e503-42b6-8d98-e48ccc516174 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:39.771694 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bd19af7b-e503-42b6-8d98-e48ccc516174 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:39.772172 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bd19af7b-e503-42b6-8d98-e48ccc516174 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:39.772947 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bd19af7b-e503-42b6-8d98-e48ccc516174 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:39.773385 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bd19af7b-e503-42b6-8d98-e48ccc516174 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:39.801396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-bd19af7b-e503-42b6-8d98-e48ccc516174 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041071 Aug 13 04:36:39.801966 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 580/1138] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:36:39 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Aug 13 04:36:39.823014 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-17adeb9a-bba9-4177-9afd-a8bf6414f230 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:39.823014 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-17adeb9a-bba9-4177-9afd-a8bf6414f230 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:39.830180 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-17adeb9a-bba9-4177-9afd-a8bf6414f230 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:39.830628 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-17adeb9a-bba9-4177-9afd-a8bf6414f230 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:39.831404 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-17adeb9a-bba9-4177-9afd-a8bf6414f230 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:39.831836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-17adeb9a-bba9-4177-9afd-a8bf6414f230 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:39.915200 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-35ddb752-563a-49dc-805b-129909648999 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:39.915775 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-35ddb752-563a-49dc-805b-129909648999 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:39.921724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-35ddb752-563a-49dc-805b-129909648999 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:39.922729 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-35ddb752-563a-49dc-805b-129909648999 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:39.923517 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-35ddb752-563a-49dc-805b-129909648999 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:39.923955 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-35ddb752-563a-49dc-805b-129909648999 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:39.954982 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-35ddb752-563a-49dc-805b-129909648999 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044087 Aug 13 04:36:39.955586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 581/1139] 10.222.0.13 () {58 vars in 1302 bytes} [Fri Aug 13 04:36:39 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Aug 13 04:36:39.957038 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-17adeb9a-bba9-4177-9afd-a8bf6414f230 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:39.964509 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-17adeb9a-bba9-4177-9afd-a8bf6414f230 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.146186 Aug 13 04:36:39.965066 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 559/1140] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:39 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:40.015319 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-632b4415-d956-4fde-b3ff-2d989f2859a1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:40.016520 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-632b4415-d956-4fde-b3ff-2d989f2859a1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:40.022501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-632b4415-d956-4fde-b3ff-2d989f2859a1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:40.022932 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-632b4415-d956-4fde-b3ff-2d989f2859a1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:40.023780 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-632b4415-d956-4fde-b3ff-2d989f2859a1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:40.024129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-632b4415-d956-4fde-b3ff-2d989f2859a1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:40.048345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-632b4415-d956-4fde-b3ff-2d989f2859a1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:36:40.121021 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-632b4415-d956-4fde-b3ff-2d989f2859a1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 204 len: 0 microversion: 2.1 time: 0.109055 Aug 13 04:36:40.121875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 582/1141] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:36:40 2021] DELETE /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:36:40.130206 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e2796fb6-a8a7-4b01-8151-8d24978e320d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:40.130757 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e2796fb6-a8a7-4b01-8151-8d24978e320d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:40.136574 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e2796fb6-a8a7-4b01-8151-8d24978e320d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:40.137021 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e2796fb6-a8a7-4b01-8151-8d24978e320d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:40.137888 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e2796fb6-a8a7-4b01-8151-8d24978e320d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:40.138323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e2796fb6-a8a7-4b01-8151-8d24978e320d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:40.260291 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e2796fb6-a8a7-4b01-8151-8d24978e320d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:40.267872 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e2796fb6-a8a7-4b01-8151-8d24978e320d tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1673 microversion: 2.1 time: 0.141335 Aug 13 04:36:40.268439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 560/1142] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:40 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1673 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:40.275114 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8af51ae4-ee49-4681-a634-469a47fc38c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:40.275818 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-8af51ae4-ee49-4681-a634-469a47fc38c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:40.281711 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8af51ae4-ee49-4681-a634-469a47fc38c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:40.282257 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8af51ae4-ee49-4681-a634-469a47fc38c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:40.283033 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8af51ae4-ee49-4681-a634-469a47fc38c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:40.283472 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-8af51ae4-ee49-4681-a634-469a47fc38c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:40.402966 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8af51ae4-ee49-4681-a634-469a47fc38c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:40.411163 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8af51ae4-ee49-4681-a634-469a47fc38c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:40.412655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-8af51ae4-ee49-4681-a634-469a47fc38c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:40.413816 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8af51ae4-ee49-4681-a634-469a47fc38c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.143071 Aug 13 04:36:40.414366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 583/1143] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:40 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:40.454664 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-6bce06b8-3082-471c-bb9c-02b1110831d3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:40.455270 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-6bce06b8-3082-471c-bb9c-02b1110831d3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:40.461151 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6bce06b8-3082-471c-bb9c-02b1110831d3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:40.461625 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6bce06b8-3082-471c-bb9c-02b1110831d3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:40.462382 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6bce06b8-3082-471c-bb9c-02b1110831d3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:40.462808 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-6bce06b8-3082-471c-bb9c-02b1110831d3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:40.580510 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-6bce06b8-3082-471c-bb9c-02b1110831d3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:40.587836 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-6bce06b8-3082-471c-bb9c-02b1110831d3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.136873 Aug 13 04:36:40.588430 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 561/1144] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:40 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:40.981338 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-21bfc37a-16ee-4fd0-9968-8523b9961d26 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:40.981986 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-21bfc37a-16ee-4fd0-9968-8523b9961d26 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:40.988006 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-21bfc37a-16ee-4fd0-9968-8523b9961d26 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:40.988465 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-21bfc37a-16ee-4fd0-9968-8523b9961d26 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:40.989238 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-21bfc37a-16ee-4fd0-9968-8523b9961d26 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:40.989711 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-21bfc37a-16ee-4fd0-9968-8523b9961d26 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:41.112047 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-21bfc37a-16ee-4fd0-9968-8523b9961d26 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:41.119288 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-21bfc37a-16ee-4fd0-9968-8523b9961d26 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.141650 Aug 13 04:36:41.119854 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 584/1145] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:40 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:41.285811 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-25167675-492c-44d6-a3e7-6c02ee09abb5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:41.286348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-25167675-492c-44d6-a3e7-6c02ee09abb5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:41.292269 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-25167675-492c-44d6-a3e7-6c02ee09abb5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:41.292719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-25167675-492c-44d6-a3e7-6c02ee09abb5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:41.293506 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-25167675-492c-44d6-a3e7-6c02ee09abb5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:41.293946 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-25167675-492c-44d6-a3e7-6c02ee09abb5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:41.417225 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-25167675-492c-44d6-a3e7-6c02ee09abb5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:41.425101 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-25167675-492c-44d6-a3e7-6c02ee09abb5 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1673 microversion: 2.1 time: 0.143356 Aug 13 04:36:41.425719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 562/1146] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:41 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1673 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:41.435970 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-de6402ac-43c7-4d08-8cbc-ff35c4d16086 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:41.437132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-de6402ac-43c7-4d08-8cbc-ff35c4d16086 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:41.445948 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de6402ac-43c7-4d08-8cbc-ff35c4d16086 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:41.446398 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de6402ac-43c7-4d08-8cbc-ff35c4d16086 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:41.447170 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de6402ac-43c7-4d08-8cbc-ff35c4d16086 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:41.447638 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-de6402ac-43c7-4d08-8cbc-ff35c4d16086 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:41.569037 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-de6402ac-43c7-4d08-8cbc-ff35c4d16086 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:41.576673 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-de6402ac-43c7-4d08-8cbc-ff35c4d16086 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:41.580069 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-de6402ac-43c7-4d08-8cbc-ff35c4d16086 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:41.581204 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-de6402ac-43c7-4d08-8cbc-ff35c4d16086 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.152596 Aug 13 04:36:41.581804 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 585/1147] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:41 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:41.604919 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c335a7e9-cb68-4919-ad65-93497465536d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:41.605574 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c335a7e9-cb68-4919-ad65-93497465536d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:41.611563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c335a7e9-cb68-4919-ad65-93497465536d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:41.612018 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c335a7e9-cb68-4919-ad65-93497465536d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:41.612783 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c335a7e9-cb68-4919-ad65-93497465536d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:41.613215 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c335a7e9-cb68-4919-ad65-93497465536d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:41.740981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c335a7e9-cb68-4919-ad65-93497465536d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:41.748184 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c335a7e9-cb68-4919-ad65-93497465536d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.146921 Aug 13 04:36:41.748741 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 563/1148] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:41 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:42.135903 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-47fadfea-d28a-43eb-a3e3-6727e37a34a0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:42.136432 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-47fadfea-d28a-43eb-a3e3-6727e37a34a0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:42.142707 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-47fadfea-d28a-43eb-a3e3-6727e37a34a0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:42.143164 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-47fadfea-d28a-43eb-a3e3-6727e37a34a0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:42.143973 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-47fadfea-d28a-43eb-a3e3-6727e37a34a0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:42.144409 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-47fadfea-d28a-43eb-a3e3-6727e37a34a0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:42.263061 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-47fadfea-d28a-43eb-a3e3-6727e37a34a0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:42.270386 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-47fadfea-d28a-43eb-a3e3-6727e37a34a0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.138223 Aug 13 04:36:42.270953 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 586/1149] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:42 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:42.450266 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a110ac89-61c6-4787-a9b4-18a8ca3e5505 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:42.450807 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a110ac89-61c6-4787-a9b4-18a8ca3e5505 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:42.457173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a110ac89-61c6-4787-a9b4-18a8ca3e5505 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:42.457658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a110ac89-61c6-4787-a9b4-18a8ca3e5505 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:42.458424 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a110ac89-61c6-4787-a9b4-18a8ca3e5505 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:42.458857 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a110ac89-61c6-4787-a9b4-18a8ca3e5505 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:42.576142 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a110ac89-61c6-4787-a9b4-18a8ca3e5505 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:42.583967 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a110ac89-61c6-4787-a9b4-18a8ca3e5505 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1673 microversion: 2.1 time: 0.137487 Aug 13 04:36:42.584532 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 564/1150] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:42 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1673 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:42.599645 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c105a084-2b0d-4949-9973-9bcafddaae1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:42.600259 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c105a084-2b0d-4949-9973-9bcafddaae1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:42.606140 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c105a084-2b0d-4949-9973-9bcafddaae1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:42.606589 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c105a084-2b0d-4949-9973-9bcafddaae1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:42.607357 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c105a084-2b0d-4949-9973-9bcafddaae1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:42.607797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c105a084-2b0d-4949-9973-9bcafddaae1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:42.732328 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c105a084-2b0d-4949-9973-9bcafddaae1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:42.740191 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c105a084-2b0d-4949-9973-9bcafddaae1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:42.741710 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c105a084-2b0d-4949-9973-9bcafddaae1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:42.742857 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c105a084-2b0d-4949-9973-9bcafddaae1e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.146886 Aug 13 04:36:42.743413 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 587/1151] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:42 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:42.765044 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f45b971a-f7bd-48c6-b8d4-559179038c00 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:42.766517 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f45b971a-f7bd-48c6-b8d4-559179038c00 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:42.772392 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f45b971a-f7bd-48c6-b8d4-559179038c00 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:42.772842 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f45b971a-f7bd-48c6-b8d4-559179038c00 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:42.773645 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f45b971a-f7bd-48c6-b8d4-559179038c00 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:42.774081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f45b971a-f7bd-48c6-b8d4-559179038c00 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:42.895873 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f45b971a-f7bd-48c6-b8d4-559179038c00 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:42.903215 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f45b971a-f7bd-48c6-b8d4-559179038c00 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.141848 Aug 13 04:36:42.903777 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 565/1152] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:42 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:43.288503 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d2acd975-f9c8-448b-b26c-a437c7b112fb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:43.289140 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d2acd975-f9c8-448b-b26c-a437c7b112fb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:43.295197 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d2acd975-f9c8-448b-b26c-a437c7b112fb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:43.295634 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d2acd975-f9c8-448b-b26c-a437c7b112fb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:43.296390 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d2acd975-f9c8-448b-b26c-a437c7b112fb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:43.297382 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d2acd975-f9c8-448b-b26c-a437c7b112fb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:43.429793 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d2acd975-f9c8-448b-b26c-a437c7b112fb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:43.437279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d2acd975-f9c8-448b-b26c-a437c7b112fb tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.152958 Aug 13 04:36:43.438466 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 588/1153] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:43 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:43.601783 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-cf49e060-5cb4-43cd-ad68-263fea281fa1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:43.602656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-cf49e060-5cb4-43cd-ad68-263fea281fa1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:43.608921 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cf49e060-5cb4-43cd-ad68-263fea281fa1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:43.610260 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cf49e060-5cb4-43cd-ad68-263fea281fa1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:43.611309 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cf49e060-5cb4-43cd-ad68-263fea281fa1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:43.611907 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cf49e060-5cb4-43cd-ad68-263fea281fa1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:43.738454 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-cf49e060-5cb4-43cd-ad68-263fea281fa1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:43.746028 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-cf49e060-5cb4-43cd-ad68-263fea281fa1 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1673 microversion: 2.1 time: 0.147939 Aug 13 04:36:43.746752 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 566/1154] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:43 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1673 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:43.761904 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-13732ed7-73c2-4790-b66c-deb360fdcfb6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:43.762514 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-13732ed7-73c2-4790-b66c-deb360fdcfb6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:43.768629 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13732ed7-73c2-4790-b66c-deb360fdcfb6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:43.769231 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13732ed7-73c2-4790-b66c-deb360fdcfb6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:43.770033 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13732ed7-73c2-4790-b66c-deb360fdcfb6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:43.770470 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-13732ed7-73c2-4790-b66c-deb360fdcfb6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:43.891990 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-13732ed7-73c2-4790-b66c-deb360fdcfb6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:43.899563 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-13732ed7-73c2-4790-b66c-deb360fdcfb6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:43.901043 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-13732ed7-73c2-4790-b66c-deb360fdcfb6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:43.902215 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-13732ed7-73c2-4790-b66c-deb360fdcfb6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.144508 Aug 13 04:36:43.902758 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 589/1155] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:43 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:43.919758 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-943a2230-4574-4831-b8a6-6a39e39e04a3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:43.920366 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-943a2230-4574-4831-b8a6-6a39e39e04a3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:43.926439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-943a2230-4574-4831-b8a6-6a39e39e04a3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:43.926885 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-943a2230-4574-4831-b8a6-6a39e39e04a3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:43.927648 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-943a2230-4574-4831-b8a6-6a39e39e04a3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:43.928078 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-943a2230-4574-4831-b8a6-6a39e39e04a3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:44.053194 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-943a2230-4574-4831-b8a6-6a39e39e04a3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:44.060739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-943a2230-4574-4831-b8a6-6a39e39e04a3 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.144396 Aug 13 04:36:44.061293 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 567/1156] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:43 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:44.455029 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3f4fcc70-239a-4caf-94d7-ea1c9b671ec5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:44.455639 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3f4fcc70-239a-4caf-94d7-ea1c9b671ec5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:44.461535 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f4fcc70-239a-4caf-94d7-ea1c9b671ec5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:44.461982 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f4fcc70-239a-4caf-94d7-ea1c9b671ec5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:44.462746 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f4fcc70-239a-4caf-94d7-ea1c9b671ec5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:44.463174 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3f4fcc70-239a-4caf-94d7-ea1c9b671ec5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:44.588232 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3f4fcc70-239a-4caf-94d7-ea1c9b671ec5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:44.596388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3f4fcc70-239a-4caf-94d7-ea1c9b671ec5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.145551 Aug 13 04:36:44.597031 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 590/1157] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:44 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:44.763441 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-8bfb2320-4809-4281-b0f9-5e4f70c1d84b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:44.763955 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-8bfb2320-4809-4281-b0f9-5e4f70c1d84b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:44.770238 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8bfb2320-4809-4281-b0f9-5e4f70c1d84b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:44.770686 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8bfb2320-4809-4281-b0f9-5e4f70c1d84b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:44.771459 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8bfb2320-4809-4281-b0f9-5e4f70c1d84b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:44.771889 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-8bfb2320-4809-4281-b0f9-5e4f70c1d84b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:44.895071 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-8bfb2320-4809-4281-b0f9-5e4f70c1d84b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:44.902466 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-8bfb2320-4809-4281-b0f9-5e4f70c1d84b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1673 microversion: 2.1 time: 0.142784 Aug 13 04:36:44.903042 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 568/1158] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:44 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1673 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:44.919741 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3d3f46e4-f748-4a67-9299-4838eb9e73e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:44.920440 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3d3f46e4-f748-4a67-9299-4838eb9e73e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:44.927228 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3d3f46e4-f748-4a67-9299-4838eb9e73e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:44.927682 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3d3f46e4-f748-4a67-9299-4838eb9e73e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:44.928472 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3d3f46e4-f748-4a67-9299-4838eb9e73e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:44.928907 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3d3f46e4-f748-4a67-9299-4838eb9e73e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:45.052509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3d3f46e4-f748-4a67-9299-4838eb9e73e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:45.060612 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3d3f46e4-f748-4a67-9299-4838eb9e73e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:45.062153 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3d3f46e4-f748-4a67-9299-4838eb9e73e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:45.063330 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3d3f46e4-f748-4a67-9299-4838eb9e73e0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.147286 Aug 13 04:36:45.063891 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 591/1159] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:44 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:45.078758 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b1e600f7-6973-47b9-9a61-dd779fb16247 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:45.080170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b1e600f7-6973-47b9-9a61-dd779fb16247 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:45.086142 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1e600f7-6973-47b9-9a61-dd779fb16247 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:45.086689 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1e600f7-6973-47b9-9a61-dd779fb16247 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:45.087537 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1e600f7-6973-47b9-9a61-dd779fb16247 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:45.088046 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b1e600f7-6973-47b9-9a61-dd779fb16247 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:45.217898 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-b1e600f7-6973-47b9-9a61-dd779fb16247 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:45.225694 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b1e600f7-6973-47b9-9a61-dd779fb16247 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.150606 Aug 13 04:36:45.226259 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 569/1160] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:45 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:45.466747 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-1431a6b6-0d30-4314-badb-b0751f884f3a req-10913f0b-5830-49cc-a96e-2ad306947863 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8018e3b0-c3af-49a1-bbca-3123c9573244", "name": "network-vif-deleted", "tag": "9aa0221a-92be-4f44-b2cb-e932740ff8ae"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:45.474762 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:45.474762 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:36:45.489206 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-1431a6b6-0d30-4314-badb-b0751f884f3a req-10913f0b-5830-49cc-a96e-2ad306947863 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:45.489823 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-1431a6b6-0d30-4314-badb-b0751f884f3a req-10913f0b-5830-49cc-a96e-2ad306947863 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:45.510451 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-1431a6b6-0d30-4314-badb-b0751f884f3a req-10913f0b-5830-49cc-a96e-2ad306947863 service nova] Creating event network-vif-deleted:9aa0221a-92be-4f44-b2cb-e932740ff8ae for instance 8018e3b0-c3af-49a1-bbca-3123c9573244 on hv-cinder-75996 Aug 13 04:36:45.517797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-1431a6b6-0d30-4314-badb-b0751f884f3a req-10913f0b-5830-49cc-a96e-2ad306947863 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055226 Aug 13 04:36:45.518335 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 592/1161] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:45 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:45.615914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7218300d-5d10-4da3-92a9-133e7565c440 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:45.616700 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7218300d-5d10-4da3-92a9-133e7565c440 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:45.632628 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7218300d-5d10-4da3-92a9-133e7565c440 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:45.633083 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7218300d-5d10-4da3-92a9-133e7565c440 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:45.634148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7218300d-5d10-4da3-92a9-133e7565c440 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:45.634595 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7218300d-5d10-4da3-92a9-133e7565c440 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:45.784113 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7218300d-5d10-4da3-92a9-133e7565c440 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:45.791517 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7218300d-5d10-4da3-92a9-133e7565c440 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.181738 Aug 13 04:36:45.792092 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 570/1162] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:45 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:45.924279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:45.925189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:45.933022 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:45.933647 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:45.934870 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:45.935650 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:45.976266 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:45.976720 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:45.977177 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lazy-loading 'fault' on Instance uuid 8018e3b0-c3af-49a1-bbca-3123c9573244 {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:36:46.026615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '45e5e56984454deb8f490bbf5a0f1435', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '14887014218041cc86fddfa8a151dcd6', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:46.038921 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-26d30480-76f2-4c9f-a44b-bd548bbd2a7b tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 200 len: 1328 microversion: 2.1 time: 0.121978 Aug 13 04:36:46.039424 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 593/1163] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:45 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 1328 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:46.081989 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a0701fc0-82ed-44c0-939b-394fd7b52ca8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:46.082610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a0701fc0-82ed-44c0-939b-394fd7b52ca8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:46.090323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a0701fc0-82ed-44c0-939b-394fd7b52ca8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:46.090897 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a0701fc0-82ed-44c0-939b-394fd7b52ca8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:46.092204 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a0701fc0-82ed-44c0-939b-394fd7b52ca8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:46.092718 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a0701fc0-82ed-44c0-939b-394fd7b52ca8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:46.224932 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a0701fc0-82ed-44c0-939b-394fd7b52ca8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:46.233246 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a0701fc0-82ed-44c0-939b-394fd7b52ca8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:46.234860 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a0701fc0-82ed-44c0-939b-394fd7b52ca8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:46.236016 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a0701fc0-82ed-44c0-939b-394fd7b52ca8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.158314 Aug 13 04:36:46.237866 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 571/1164] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:46 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:46.242875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b0d8d24a-ea95-4af5-9aaa-7caf1b49aeaa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:46.243503 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b0d8d24a-ea95-4af5-9aaa-7caf1b49aeaa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:46.249637 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b0d8d24a-ea95-4af5-9aaa-7caf1b49aeaa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:46.250138 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b0d8d24a-ea95-4af5-9aaa-7caf1b49aeaa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:46.250972 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b0d8d24a-ea95-4af5-9aaa-7caf1b49aeaa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:46.251411 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b0d8d24a-ea95-4af5-9aaa-7caf1b49aeaa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:46.365456 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f328c6d1-39f0-446c-b340-b9845a78f176 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:46.366205 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f328c6d1-39f0-446c-b340-b9845a78f176 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:46.373021 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f328c6d1-39f0-446c-b340-b9845a78f176 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:46.373686 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f328c6d1-39f0-446c-b340-b9845a78f176 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:46.374651 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f328c6d1-39f0-446c-b340-b9845a78f176 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:46.375329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f328c6d1-39f0-446c-b340-b9845a78f176 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:46.383241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b0d8d24a-ea95-4af5-9aaa-7caf1b49aeaa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:46.392168 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b0d8d24a-ea95-4af5-9aaa-7caf1b49aeaa tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.152881 Aug 13 04:36:46.392929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 594/1165] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:46 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:46.471844 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-f328c6d1-39f0-446c-b340-b9845a78f176 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lazy-loading 'services' on Instance uuid fbe520d7-325b-4eb8-8a4b-f2708055fe56 {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:36:46.536484 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f328c6d1-39f0-446c-b340-b9845a78f176 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56/os-volume_attachments/97dae9c1-500a-45d6-a9d6-c287d732fc4f" status: 202 len: 0 microversion: 2.1 time: 0.174643 Aug 13 04:36:46.537260 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 572/1166] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:36:46 2021] DELETE /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56/os-volume_attachments/97dae9c1-500a-45d6-a9d6-c287d732fc4f => generated 0 bytes in 176 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:46.808018 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-03eb0ef4-79c0-4a56-8cd9-dd3bdaf59ad2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:46.808684 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-03eb0ef4-79c0-4a56-8cd9-dd3bdaf59ad2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:46.816079 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03eb0ef4-79c0-4a56-8cd9-dd3bdaf59ad2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:46.816436 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03eb0ef4-79c0-4a56-8cd9-dd3bdaf59ad2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:46.817235 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03eb0ef4-79c0-4a56-8cd9-dd3bdaf59ad2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:46.817785 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-03eb0ef4-79c0-4a56-8cd9-dd3bdaf59ad2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:46.943716 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-03eb0ef4-79c0-4a56-8cd9-dd3bdaf59ad2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:46.950977 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-03eb0ef4-79c0-4a56-8cd9-dd3bdaf59ad2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.146747 Aug 13 04:36:46.951572 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 595/1167] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:46 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:47.060646 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d04b0d20-2f82-4bd7-8040-4a9b47dabe52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:47.061360 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d04b0d20-2f82-4bd7-8040-4a9b47dabe52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:47.069356 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d04b0d20-2f82-4bd7-8040-4a9b47dabe52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.069840 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d04b0d20-2f82-4bd7-8040-4a9b47dabe52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.070654 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d04b0d20-2f82-4bd7-8040-4a9b47dabe52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.071055 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d04b0d20-2f82-4bd7-8040-4a9b47dabe52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.085410 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-d04b0d20-2f82-4bd7-8040-4a9b47dabe52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] HTTP exception thrown: Instance 8018e3b0-c3af-49a1-bbca-3123c9573244 could not be found. Aug 13 04:36:47.086069 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d04b0d20-2f82-4bd7-8040-4a9b47dabe52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Returning 404 to user: Instance 8018e3b0-c3af-49a1-bbca-3123c9573244 could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:36:47.086843 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d04b0d20-2f82-4bd7-8040-4a9b47dabe52 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 404 len: 111 microversion: 2.1 time: 0.031534 Aug 13 04:36:47.087387 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 573/1168] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:47 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 13 04:36:47.095983 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-8ab18e96-7e13-4960-9916-c660bb03d724 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '.version_select at 0x7fc45fdd3a60>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:47.117080 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-8ab18e96-7e13-4960-9916-c660bb03d724 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193055186" status: 202 len: 0 microversion: 2.1 time: 0.025137 Aug 13 04:36:47.117676 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 596/1169] 10.222.0.13 () {58 vars in 1221 bytes} [Fri Aug 13 04:36:47 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193055186 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:36:47.255232 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a8b6cbe8-8e1f-488b-aa19-9e6f19376ae1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:47.255849 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a8b6cbe8-8e1f-488b-aa19-9e6f19376ae1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:47.262725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8b6cbe8-8e1f-488b-aa19-9e6f19376ae1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.263414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8b6cbe8-8e1f-488b-aa19-9e6f19376ae1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.264423 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8b6cbe8-8e1f-488b-aa19-9e6f19376ae1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.265054 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a8b6cbe8-8e1f-488b-aa19-9e6f19376ae1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.404302 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a8b6cbe8-8e1f-488b-aa19-9e6f19376ae1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:47.409810 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-73e47918-fed4-4455-bc41-c678b38d038b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:47.410772 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-73e47918-fed4-4455-bc41-c678b38d038b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:47.413240 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a8b6cbe8-8e1f-488b-aa19-9e6f19376ae1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:47.414788 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a8b6cbe8-8e1f-488b-aa19-9e6f19376ae1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:47.415942 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a8b6cbe8-8e1f-488b-aa19-9e6f19376ae1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.164822 Aug 13 04:36:47.416499 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 574/1170] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:47 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:47.416720 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-73e47918-fed4-4455-bc41-c678b38d038b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.417176 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-73e47918-fed4-4455-bc41-c678b38d038b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.418092 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-73e47918-fed4-4455-bc41-c678b38d038b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.418596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-73e47918-fed4-4455-bc41-c678b38d038b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.698993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f58424fb-7ad9-46c6-9ae5-503d18288a42 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:47.699711 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f58424fb-7ad9-46c6-9ae5-503d18288a42 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:47.708049 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f58424fb-7ad9-46c6-9ae5-503d18288a42 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.708780 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f58424fb-7ad9-46c6-9ae5-503d18288a42 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.710414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f58424fb-7ad9-46c6-9ae5-503d18288a42 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.711111 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f58424fb-7ad9-46c6-9ae5-503d18288a42 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.741879 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f58424fb-7ad9-46c6-9ae5-503d18288a42 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Going to try to terminate instance {{(pid=108288) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:36:47.831189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-73e47918-fed4-4455-bc41-c678b38d038b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:47.843254 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-73e47918-fed4-4455-bc41-c678b38d038b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.437228 Aug 13 04:36:47.847709 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f58424fb-7ad9-46c6-9ae5-503d18288a42 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 204 len: 0 microversion: 2.1 time: 0.152302 Aug 13 04:36:47.848623 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 575/1171] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:36:47 2021] DELETE /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 13 04:36:47.850162 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 597/1172] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:47 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:47.860542 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-5e421deb-d22e-4ccd-9b03-5da0e691633f req-d017f345-5c6d-49f4-99d2-9c30469d1f86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fee77a-c81e-400f-8a01-959a6d472e9c", "name": "network-vif-plugged", "status": "completed", "tag": "b09d6a5f-8290-4c39-852c-99ab3183d05c"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:47.863362 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:47.863362 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:36:47.867453 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c3476bdc-d420-4006-bfeb-52eb7c6dba18 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:47.868012 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c3476bdc-d420-4006-bfeb-52eb7c6dba18 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:47.874169 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c3476bdc-d420-4006-bfeb-52eb7c6dba18 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.875125 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c3476bdc-d420-4006-bfeb-52eb7c6dba18 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.876314 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c3476bdc-d420-4006-bfeb-52eb7c6dba18 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.876888 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c3476bdc-d420-4006-bfeb-52eb7c6dba18 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.881854 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-5e421deb-d22e-4ccd-9b03-5da0e691633f req-d017f345-5c6d-49f4-99d2-9c30469d1f86 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.884427 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-5e421deb-d22e-4ccd-9b03-5da0e691633f req-d017f345-5c6d-49f4-99d2-9c30469d1f86 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.900961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-5e421deb-d22e-4ccd-9b03-5da0e691633f req-d017f345-5c6d-49f4-99d2-9c30469d1f86 service nova] Creating event network-vif-plugged:b09d6a5f-8290-4c39-852c-99ab3183d05c for instance 06fee77a-c81e-400f-8a01-959a6d472e9c on hv-cinder-75996 Aug 13 04:36:47.906953 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-5e421deb-d22e-4ccd-9b03-5da0e691633f req-d017f345-5c6d-49f4-99d2-9c30469d1f86 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055302 Aug 13 04:36:47.908619 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 576/1173] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:47 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:47.972002 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4eb87c55-1a7d-42b4-888f-e6020a7bc4e6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:47.972772 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4eb87c55-1a7d-42b4-888f-e6020a7bc4e6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:47.979060 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4eb87c55-1a7d-42b4-888f-e6020a7bc4e6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.979517 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4eb87c55-1a7d-42b4-888f-e6020a7bc4e6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:47.980448 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4eb87c55-1a7d-42b4-888f-e6020a7bc4e6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:47.980895 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4eb87c55-1a7d-42b4-888f-e6020a7bc4e6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:48.018315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c3476bdc-d420-4006-bfeb-52eb7c6dba18 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:48.026687 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c3476bdc-d420-4006-bfeb-52eb7c6dba18 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1514 microversion: 2.1 time: 0.167754 Aug 13 04:36:48.027508 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 598/1174] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:47 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1514 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:48.112497 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4eb87c55-1a7d-42b4-888f-e6020a7bc4e6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:48.119843 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4eb87c55-1a7d-42b4-888f-e6020a7bc4e6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1267 microversion: 2.1 time: 0.155747 Aug 13 04:36:48.120336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 577/1175] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:47 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1267 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:48.434682 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-747268bd-b21a-4a81-b25f-edc1f1b45731 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:48.435490 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-747268bd-b21a-4a81-b25f-edc1f1b45731 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:48.441710 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-747268bd-b21a-4a81-b25f-edc1f1b45731 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:48.442161 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-747268bd-b21a-4a81-b25f-edc1f1b45731 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:48.442923 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-747268bd-b21a-4a81-b25f-edc1f1b45731 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:48.443359 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-747268bd-b21a-4a81-b25f-edc1f1b45731 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:48.562629 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-747268bd-b21a-4a81-b25f-edc1f1b45731 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:48.570422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-747268bd-b21a-4a81-b25f-edc1f1b45731 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:48.571930 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-747268bd-b21a-4a81-b25f-edc1f1b45731 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:48.573073 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-747268bd-b21a-4a81-b25f-edc1f1b45731 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.142226 Aug 13 04:36:48.573668 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 599/1176] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:48 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:48.861838 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5328af3e-8620-4b31-b671-40a20807fef4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:48.862452 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5328af3e-8620-4b31-b671-40a20807fef4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:48.868382 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5328af3e-8620-4b31-b671-40a20807fef4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:48.868824 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5328af3e-8620-4b31-b671-40a20807fef4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:48.869622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5328af3e-8620-4b31-b671-40a20807fef4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:48.870065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5328af3e-8620-4b31-b671-40a20807fef4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:49.004746 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5328af3e-8620-4b31-b671-40a20807fef4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:49.013282 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5328af3e-8620-4b31-b671-40a20807fef4 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.155380 Aug 13 04:36:49.014035 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 578/1177] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:48 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:49.045690 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1fdfe5c3-a81d-4e2f-96ff-f90d22c18277 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:49.046308 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1fdfe5c3-a81d-4e2f-96ff-f90d22c18277 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:49.053366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1fdfe5c3-a81d-4e2f-96ff-f90d22c18277 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:49.053946 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1fdfe5c3-a81d-4e2f-96ff-f90d22c18277 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:49.054809 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1fdfe5c3-a81d-4e2f-96ff-f90d22c18277 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:49.055252 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1fdfe5c3-a81d-4e2f-96ff-f90d22c18277 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:49.135962 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c572f3af-1275-4bfa-862e-c980775ce840 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:49.136572 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c572f3af-1275-4bfa-862e-c980775ce840 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:49.143250 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c572f3af-1275-4bfa-862e-c980775ce840 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:49.143862 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c572f3af-1275-4bfa-862e-c980775ce840 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:49.144650 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c572f3af-1275-4bfa-862e-c980775ce840 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:49.145147 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c572f3af-1275-4bfa-862e-c980775ce840 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:49.199293 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1fdfe5c3-a81d-4e2f-96ff-f90d22c18277 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:49.206594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1fdfe5c3-a81d-4e2f-96ff-f90d22c18277 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1514 microversion: 2.1 time: 0.165644 Aug 13 04:36:49.207163 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 600/1178] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:49 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1514 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:49.273298 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-c572f3af-1275-4bfa-862e-c980775ce840 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:49.281856 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c572f3af-1275-4bfa-862e-c980775ce840 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1453 microversion: 2.1 time: 0.149144 Aug 13 04:36:49.282431 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 579/1179] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:49 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1453 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:36:49.298485 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c2c2fb4c-893d-4bd5-a7c3-5a9b421826be tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:49.299172 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c2c2fb4c-893d-4bd5-a7c3-5a9b421826be tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:49.305170 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2c2fb4c-893d-4bd5-a7c3-5a9b421826be tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:49.305687 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2c2fb4c-893d-4bd5-a7c3-5a9b421826be tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:49.306598 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2c2fb4c-893d-4bd5-a7c3-5a9b421826be tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:49.307130 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c2c2fb4c-893d-4bd5-a7c3-5a9b421826be tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:49.429108 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c2c2fb4c-893d-4bd5-a7c3-5a9b421826be tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:49.436660 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c2c2fb4c-893d-4bd5-a7c3-5a9b421826be tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1453 microversion: 2.1 time: 0.142561 Aug 13 04:36:49.437237 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 601/1180] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:49 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1453 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:49.591947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-009922e1-b92f-4084-8b9b-aa18a7be2f72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:49.592658 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-009922e1-b92f-4084-8b9b-aa18a7be2f72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:49.600455 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-009922e1-b92f-4084-8b9b-aa18a7be2f72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:49.600988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-009922e1-b92f-4084-8b9b-aa18a7be2f72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:49.601865 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-009922e1-b92f-4084-8b9b-aa18a7be2f72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:49.602298 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-009922e1-b92f-4084-8b9b-aa18a7be2f72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:49.751151 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-009922e1-b92f-4084-8b9b-aa18a7be2f72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:49.759200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-009922e1-b92f-4084-8b9b-aa18a7be2f72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:49.760696 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-009922e1-b92f-4084-8b9b-aa18a7be2f72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:49.762098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-009922e1-b92f-4084-8b9b-aa18a7be2f72 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.174186 Aug 13 04:36:49.762649 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 580/1181] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:49 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:50.030891 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7b1a7e2c-7e31-47e4-99af-8222dcd1542d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:50.031608 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7b1a7e2c-7e31-47e4-99af-8222dcd1542d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:50.039132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7b1a7e2c-7e31-47e4-99af-8222dcd1542d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.039710 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7b1a7e2c-7e31-47e4-99af-8222dcd1542d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.040689 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7b1a7e2c-7e31-47e4-99af-8222dcd1542d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.041256 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7b1a7e2c-7e31-47e4-99af-8222dcd1542d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.147885 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4f88e1a2-2881-4b0f-9b07-facd129fbb69 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:50.148422 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4f88e1a2-2881-4b0f-9b07-facd129fbb69 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:50.159437 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f88e1a2-2881-4b0f-9b07-facd129fbb69 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.159922 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f88e1a2-2881-4b0f-9b07-facd129fbb69 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.160727 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f88e1a2-2881-4b0f-9b07-facd129fbb69 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.161172 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f88e1a2-2881-4b0f-9b07-facd129fbb69 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.180131 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-4f88e1a2-2881-4b0f-9b07-facd129fbb69 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] HTTP exception thrown: Instance 8018e3b0-c3af-49a1-bbca-3123c9573244 could not be found. Aug 13 04:36:50.180728 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4f88e1a2-2881-4b0f-9b07-facd129fbb69 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Returning 404 to user: Instance 8018e3b0-c3af-49a1-bbca-3123c9573244 could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:36:50.181802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4f88e1a2-2881-4b0f-9b07-facd129fbb69 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 404 len: 111 microversion: 2.1 time: 0.037712 Aug 13 04:36:50.185882 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 581/1182] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:36:50 2021] DELETE /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 13 04:36:50.190390 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7b1a7e2c-7e31-47e4-99af-8222dcd1542d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:50.191759 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-43e6eb1d-b957-44f1-9e6d-ca177ba50026 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:50.192387 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-43e6eb1d-b957-44f1-9e6d-ca177ba50026 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: 8018e3b0-c3af-49a1-bbca-3123c9573244] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:50.198456 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-43e6eb1d-b957-44f1-9e6d-ca177ba50026 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.198903 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-43e6eb1d-b957-44f1-9e6d-ca177ba50026 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.199864 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-43e6eb1d-b957-44f1-9e6d-ca177ba50026 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.200310 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-43e6eb1d-b957-44f1-9e6d-ca177ba50026 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.200507 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7b1a7e2c-7e31-47e4-99af-8222dcd1542d tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.172956 Aug 13 04:36:50.210061 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 602/1183] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:50 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:50.215484 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-43e6eb1d-b957-44f1-9e6d-ca177ba50026 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] HTTP exception thrown: Instance 8018e3b0-c3af-49a1-bbca-3123c9573244 could not be found. Aug 13 04:36:50.216100 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-43e6eb1d-b957-44f1-9e6d-ca177ba50026 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Returning 404 to user: Instance 8018e3b0-c3af-49a1-bbca-3123c9573244 could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:36:50.218841 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-43e6eb1d-b957-44f1-9e6d-ca177ba50026 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244" status: 404 len: 111 microversion: 2.1 time: 0.029880 Aug 13 04:36:50.218841 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 582/1184] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:50 2021] GET /compute/v2.1/servers/8018e3b0-c3af-49a1-bbca-3123c9573244 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:36:50.227293 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-58e422b6-3916-4261-a313-615fe3e82eaa tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:50.227919 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-58e422b6-3916-4261-a313-615fe3e82eaa tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:50.234679 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58e422b6-3916-4261-a313-615fe3e82eaa tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.235422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58e422b6-3916-4261-a313-615fe3e82eaa tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.237194 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58e422b6-3916-4261-a313-615fe3e82eaa tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.237874 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58e422b6-3916-4261-a313-615fe3e82eaa tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.415766 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-58e422b6-3916-4261-a313-615fe3e82eaa tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:50.423186 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-58e422b6-3916-4261-a313-615fe3e82eaa tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 200 len: 1514 microversion: 2.1 time: 0.201377 Aug 13 04:36:50.423791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 603/1185] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:50 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 1514 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:50.678276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-b52acaf6-2c3e-47a2-8b90-94e4d2b09df5 req-fef8cb18-5c9c-4ab8-850e-bdd45a830d9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fbe520d7-325b-4eb8-8a4b-f2708055fe56", "name": "network-vif-deleted", "tag": "9e94bb8a-0301-4eda-b881-d66c4e39a5cd"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:50.680063 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:50.680063 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:36:50.690236 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-b52acaf6-2c3e-47a2-8b90-94e4d2b09df5 req-fef8cb18-5c9c-4ab8-850e-bdd45a830d9e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.690667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-b52acaf6-2c3e-47a2-8b90-94e4d2b09df5 req-fef8cb18-5c9c-4ab8-850e-bdd45a830d9e service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.702273 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-b52acaf6-2c3e-47a2-8b90-94e4d2b09df5 req-fef8cb18-5c9c-4ab8-850e-bdd45a830d9e service nova] Creating event network-vif-deleted:9e94bb8a-0301-4eda-b881-d66c4e39a5cd for instance fbe520d7-325b-4eb8-8a4b-f2708055fe56 on hv-cinder-75996 Aug 13 04:36:50.708102 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-b52acaf6-2c3e-47a2-8b90-94e4d2b09df5 req-fef8cb18-5c9c-4ab8-850e-bdd45a830d9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033713 Aug 13 04:36:50.708698 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 583/1186] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:50 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:50.783467 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-5ae3c1cf-955b-4e03-9cf8-1fe7b15bc311 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:50.784010 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-5ae3c1cf-955b-4e03-9cf8-1fe7b15bc311 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:50.791272 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5ae3c1cf-955b-4e03-9cf8-1fe7b15bc311 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.791693 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5ae3c1cf-955b-4e03-9cf8-1fe7b15bc311 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.792480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5ae3c1cf-955b-4e03-9cf8-1fe7b15bc311 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:50.792914 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-5ae3c1cf-955b-4e03-9cf8-1fe7b15bc311 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:50.936490 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5ae3c1cf-955b-4e03-9cf8-1fe7b15bc311 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:50.945189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5ae3c1cf-955b-4e03-9cf8-1fe7b15bc311 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:50.946731 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-5ae3c1cf-955b-4e03-9cf8-1fe7b15bc311 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:50.947877 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-5ae3c1cf-955b-4e03-9cf8-1fe7b15bc311 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.168798 Aug 13 04:36:50.948440 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 604/1187] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:50 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:51.220026 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d1ceeade-6717-4eeb-ae6b-1ebe6e9677ae tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:51.221314 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d1ceeade-6717-4eeb-ae6b-1ebe6e9677ae tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:51.228912 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1ceeade-6717-4eeb-ae6b-1ebe6e9677ae tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:51.229470 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1ceeade-6717-4eeb-ae6b-1ebe6e9677ae tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:51.230261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1ceeade-6717-4eeb-ae6b-1ebe6e9677ae tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:51.230700 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d1ceeade-6717-4eeb-ae6b-1ebe6e9677ae tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:51.357816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d1ceeade-6717-4eeb-ae6b-1ebe6e9677ae tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:51.365994 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d1ceeade-6717-4eeb-ae6b-1ebe6e9677ae tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.151771 Aug 13 04:36:51.366566 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 584/1188] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:51 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:51.396615 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-32d729f1-cdbe-4807-baae-aefe3829cb67 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:51.397187 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-32d729f1-cdbe-4807-baae-aefe3829cb67 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:51.403223 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-32d729f1-cdbe-4807-baae-aefe3829cb67 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:51.403675 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-32d729f1-cdbe-4807-baae-aefe3829cb67 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:51.404446 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-32d729f1-cdbe-4807-baae-aefe3829cb67 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:51.404884 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-32d729f1-cdbe-4807-baae-aefe3829cb67 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:51.418702 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-32d729f1-cdbe-4807-baae-aefe3829cb67 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] HTTP exception thrown: Instance a0662f42-e77d-4f85-84ad-b58befdc445d could not be found. Aug 13 04:36:51.419306 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-32d729f1-cdbe-4807-baae-aefe3829cb67 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Returning 404 to user: Instance a0662f42-e77d-4f85-84ad-b58befdc445d could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:36:51.420127 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-32d729f1-cdbe-4807-baae-aefe3829cb67 tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 404 len: 111 microversion: 2.1 time: 0.027214 Aug 13 04:36:51.420664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 605/1189] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:36:51 2021] DELETE /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:36:51.428740 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2cee9781-60b8-4cc2-85a5-f4b5d69bbd1f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:51.429353 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2cee9781-60b8-4cc2-85a5-f4b5d69bbd1f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] [instance: a0662f42-e77d-4f85-84ad-b58befdc445d] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:51.435535 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2cee9781-60b8-4cc2-85a5-f4b5d69bbd1f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:51.436103 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2cee9781-60b8-4cc2-85a5-f4b5d69bbd1f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:51.436749 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2cee9781-60b8-4cc2-85a5-f4b5d69bbd1f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:51.437203 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2cee9781-60b8-4cc2-85a5-f4b5d69bbd1f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:51.441196 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7317c963-3fb8-487a-9a39-f39ca29cc81a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:51.442163 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7317c963-3fb8-487a-9a39-f39ca29cc81a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fbe520d7-325b-4eb8-8a4b-f2708055fe56] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:51.448103 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7317c963-3fb8-487a-9a39-f39ca29cc81a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:51.448694 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7317c963-3fb8-487a-9a39-f39ca29cc81a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:51.449594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7317c963-3fb8-487a-9a39-f39ca29cc81a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:51.450161 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7317c963-3fb8-487a-9a39-f39ca29cc81a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:51.452035 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-2cee9781-60b8-4cc2-85a5-f4b5d69bbd1f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] HTTP exception thrown: Instance a0662f42-e77d-4f85-84ad-b58befdc445d could not be found. Aug 13 04:36:51.452758 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2cee9781-60b8-4cc2-85a5-f4b5d69bbd1f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] Returning 404 to user: Instance a0662f42-e77d-4f85-84ad-b58befdc445d could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:36:51.454433 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2cee9781-60b8-4cc2-85a5-f4b5d69bbd1f tempest-AttachVolumeTestJSON-171758676 tempest-AttachVolumeTestJSON-171758676-project] 10.222.0.13 "GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d" status: 404 len: 111 microversion: 2.1 time: 0.029359 Aug 13 04:36:51.456589 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 585/1190] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:51 2021] GET /compute/v2.1/servers/a0662f42-e77d-4f85-84ad-b58befdc445d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:36:51.465407 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-7317c963-3fb8-487a-9a39-f39ca29cc81a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] HTTP exception thrown: Instance fbe520d7-325b-4eb8-8a4b-f2708055fe56 could not be found. Aug 13 04:36:51.466026 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7317c963-3fb8-487a-9a39-f39ca29cc81a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Returning 404 to user: Instance fbe520d7-325b-4eb8-8a4b-f2708055fe56 could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:36:51.466848 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7317c963-3fb8-487a-9a39-f39ca29cc81a tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56" status: 404 len: 111 microversion: 2.1 time: 0.030180 Aug 13 04:36:51.467384 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 606/1191] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:51 2021] GET /compute/v2.1/servers/fbe520d7-325b-4eb8-8a4b-f2708055fe56 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Aug 13 04:36:51.966633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-245faafd-cb8f-4145-be71-6c29e1b16ddc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:51.967654 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-245faafd-cb8f-4145-be71-6c29e1b16ddc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:51.974053 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-245faafd-cb8f-4145-be71-6c29e1b16ddc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:51.974653 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-245faafd-cb8f-4145-be71-6c29e1b16ddc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:51.975568 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-245faafd-cb8f-4145-be71-6c29e1b16ddc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:51.976098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-245faafd-cb8f-4145-be71-6c29e1b16ddc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:52.002128 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-94615509-90aa-4d8c-9938-e07e544aadef req-cb073d2f-4b4e-4521-8685-67127cb913f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba719a9-61df-4d8d-99c1-907f97a80e8e", "name": "network-vif-plugged", "status": "completed", "tag": "1166ab58-4fa6-49a1-b301-c03b411d9dc0"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:52.005236 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:52.005236 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:36:52.021378 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-94615509-90aa-4d8c-9938-e07e544aadef req-cb073d2f-4b4e-4521-8685-67127cb913f2 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:52.022241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-94615509-90aa-4d8c-9938-e07e544aadef req-cb073d2f-4b4e-4521-8685-67127cb913f2 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:52.038667 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-94615509-90aa-4d8c-9938-e07e544aadef req-cb073d2f-4b4e-4521-8685-67127cb913f2 service nova] Creating event network-vif-plugged:1166ab58-4fa6-49a1-b301-c03b411d9dc0 for instance 5ba719a9-61df-4d8d-99c1-907f97a80e8e on hv-cinder-75996 Aug 13 04:36:52.044539 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-94615509-90aa-4d8c-9938-e07e544aadef req-cb073d2f-4b4e-4521-8685-67127cb913f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050076 Aug 13 04:36:52.046011 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 607/1192] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:51 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:36:52.119724 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-245faafd-cb8f-4145-be71-6c29e1b16ddc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:52.129016 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-245faafd-cb8f-4145-be71-6c29e1b16ddc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:52.130553 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-245faafd-cb8f-4145-be71-6c29e1b16ddc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:52.131684 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-245faafd-cb8f-4145-be71-6c29e1b16ddc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.169360 Aug 13 04:36:52.132260 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 586/1193] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:51 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:36:52.383781 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-96902747-de75-4c46-b839-fe5ed100ed51 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:52.384499 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-96902747-de75-4c46-b839-fe5ed100ed51 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:52.391435 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-96902747-de75-4c46-b839-fe5ed100ed51 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:52.391895 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-96902747-de75-4c46-b839-fe5ed100ed51 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:52.392819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-96902747-de75-4c46-b839-fe5ed100ed51 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:52.393258 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-96902747-de75-4c46-b839-fe5ed100ed51 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:52.527548 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-96902747-de75-4c46-b839-fe5ed100ed51 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:52.538228 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-96902747-de75-4c46-b839-fe5ed100ed51 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.158764 Aug 13 04:36:52.546315 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 608/1194] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:52 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:52.746512 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-07d66843-9506-4ccf-99a1-1d50052234ea req-245e13d4-73b3-4f0a-934a-52ac3a046a76 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fee77a-c81e-400f-8a01-959a6d472e9c", "tag": "b09d6a5f-8290-4c39-852c-99ab3183d05c"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:52.748026 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:52.748026 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:36:52.756480 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-07d66843-9506-4ccf-99a1-1d50052234ea req-245e13d4-73b3-4f0a-934a-52ac3a046a76 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:52.757061 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-07d66843-9506-4ccf-99a1-1d50052234ea req-245e13d4-73b3-4f0a-934a-52ac3a046a76 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:52.770028 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-07d66843-9506-4ccf-99a1-1d50052234ea req-245e13d4-73b3-4f0a-934a-52ac3a046a76 service nova] Creating event network-changed:b09d6a5f-8290-4c39-852c-99ab3183d05c for instance 06fee77a-c81e-400f-8a01-959a6d472e9c on hv-cinder-75996 Aug 13 04:36:52.775294 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-07d66843-9506-4ccf-99a1-1d50052234ea req-245e13d4-73b3-4f0a-934a-52ac3a046a76 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032293 Aug 13 04:36:52.776027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 587/1195] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:53.150789 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-57c578ca-e63e-4e25-b69c-fb9c64a18612 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:53.151421 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-57c578ca-e63e-4e25-b69c-fb9c64a18612 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:53.158433 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-57c578ca-e63e-4e25-b69c-fb9c64a18612 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:53.158886 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-57c578ca-e63e-4e25-b69c-fb9c64a18612 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:53.159669 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-57c578ca-e63e-4e25-b69c-fb9c64a18612 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:53.160105 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-57c578ca-e63e-4e25-b69c-fb9c64a18612 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:53.280480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-57c578ca-e63e-4e25-b69c-fb9c64a18612 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:53.288524 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-57c578ca-e63e-4e25-b69c-fb9c64a18612 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:53.290181 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-57c578ca-e63e-4e25-b69c-fb9c64a18612 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:53.291461 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-57c578ca-e63e-4e25-b69c-fb9c64a18612 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.144571 Aug 13 04:36:53.292099 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 609/1196] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:53 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:53.556329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-afc6e78e-dd61-4389-a2b5-274bf059bb23 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:53.556943 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-afc6e78e-dd61-4389-a2b5-274bf059bb23 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:53.563745 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-afc6e78e-dd61-4389-a2b5-274bf059bb23 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:53.564187 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-afc6e78e-dd61-4389-a2b5-274bf059bb23 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:53.565147 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-afc6e78e-dd61-4389-a2b5-274bf059bb23 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:53.565811 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-afc6e78e-dd61-4389-a2b5-274bf059bb23 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:53.708067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-afc6e78e-dd61-4389-a2b5-274bf059bb23 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:53.725501 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-afc6e78e-dd61-4389-a2b5-274bf059bb23 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.172853 Aug 13 04:36:53.730957 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 588/1197] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:53 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:54.309105 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-976224ae-3590-4983-b308-8c1d43c19351 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:54.309793 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-976224ae-3590-4983-b308-8c1d43c19351 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:54.318936 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-976224ae-3590-4983-b308-8c1d43c19351 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:54.319396 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-976224ae-3590-4983-b308-8c1d43c19351 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:54.320177 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-976224ae-3590-4983-b308-8c1d43c19351 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:54.320646 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-976224ae-3590-4983-b308-8c1d43c19351 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:54.447593 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-976224ae-3590-4983-b308-8c1d43c19351 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:54.455828 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-976224ae-3590-4983-b308-8c1d43c19351 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:54.457324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-976224ae-3590-4983-b308-8c1d43c19351 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:54.458495 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-976224ae-3590-4983-b308-8c1d43c19351 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.153302 Aug 13 04:36:54.459053 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 610/1198] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:54 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:54.749191 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ef842314-e1d6-408d-98f5-a35e8b815a89 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:54.750540 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ef842314-e1d6-408d-98f5-a35e8b815a89 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:54.769765 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef842314-e1d6-408d-98f5-a35e8b815a89 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:54.770628 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef842314-e1d6-408d-98f5-a35e8b815a89 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:54.773562 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef842314-e1d6-408d-98f5-a35e8b815a89 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:54.774244 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef842314-e1d6-408d-98f5-a35e8b815a89 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:55.140091 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ef842314-e1d6-408d-98f5-a35e8b815a89 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:55.149677 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ef842314-e1d6-408d-98f5-a35e8b815a89 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1575 microversion: 2.1 time: 0.404063 Aug 13 04:36:55.150332 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 589/1199] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:54 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1575 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:55.476802 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c5983bf6-8d1f-44bd-bb97-9a212cc71d4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:55.479295 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c5983bf6-8d1f-44bd-bb97-9a212cc71d4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:55.487795 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5983bf6-8d1f-44bd-bb97-9a212cc71d4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:55.488251 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5983bf6-8d1f-44bd-bb97-9a212cc71d4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:55.489034 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5983bf6-8d1f-44bd-bb97-9a212cc71d4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:55.490531 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5983bf6-8d1f-44bd-bb97-9a212cc71d4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:55.627321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c5983bf6-8d1f-44bd-bb97-9a212cc71d4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:55.635135 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c5983bf6-8d1f-44bd-bb97-9a212cc71d4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:55.636792 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c5983bf6-8d1f-44bd-bb97-9a212cc71d4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:55.638014 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c5983bf6-8d1f-44bd-bb97-9a212cc71d4f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1741 microversion: 2.20 time: 0.165228 Aug 13 04:36:55.649448 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 611/1200] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:55 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1741 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:56.168133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1f0eb955-da62-434d-abd9-9d8407bf42e7 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:56.169018 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1f0eb955-da62-434d-abd9-9d8407bf42e7 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:56.176007 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1f0eb955-da62-434d-abd9-9d8407bf42e7 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:56.176532 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1f0eb955-da62-434d-abd9-9d8407bf42e7 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:56.177625 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1f0eb955-da62-434d-abd9-9d8407bf42e7 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:56.178245 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1f0eb955-da62-434d-abd9-9d8407bf42e7 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:56.312554 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1f0eb955-da62-434d-abd9-9d8407bf42e7 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:56.320431 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1f0eb955-da62-434d-abd9-9d8407bf42e7 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1562 microversion: 2.1 time: 0.156574 Aug 13 04:36:56.321004 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 590/1201] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:36:56 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1562 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:36:56.655815 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-146f5dfb-3989-4509-84cd-212db2abb150 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:56.656477 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-146f5dfb-3989-4509-84cd-212db2abb150 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:56.662632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-146f5dfb-3989-4509-84cd-212db2abb150 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:56.663005 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-146f5dfb-3989-4509-84cd-212db2abb150 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:56.663771 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-146f5dfb-3989-4509-84cd-212db2abb150 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:56.664200 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-146f5dfb-3989-4509-84cd-212db2abb150 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:56.788191 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-146f5dfb-3989-4509-84cd-212db2abb150 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:56.795914 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-146f5dfb-3989-4509-84cd-212db2abb150 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:56.797937 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-146f5dfb-3989-4509-84cd-212db2abb150 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:56.799044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-146f5dfb-3989-4509-84cd-212db2abb150 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1741 microversion: 2.20 time: 0.146978 Aug 13 04:36:56.799589 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 612/1202] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:56 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1741 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:57.737789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1c2493b1-faac-450a-aa10-247b15121b71 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc46d1fe820>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:57.788009 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1c2493b1-faac-450a-aa10-247b15121b71 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/fff25f88-94e4-424b-81ed-b7555190523b" status: 200 len: 350 microversion: 2.1 time: 0.053829 Aug 13 04:36:57.788613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 591/1203] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:36:57 2021] GET /compute/v2.1/os-volumes/fff25f88-94e4-424b-81ed-b7555190523b => generated 350 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:57.818963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-303619b0-e5c0-4f8b-8617-5e701cd95896 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:57.819590 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-303619b0-e5c0-4f8b-8617-5e701cd95896 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:57.825871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-303619b0-e5c0-4f8b-8617-5e701cd95896 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:57.826397 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-303619b0-e5c0-4f8b-8617-5e701cd95896 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:57.827354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-303619b0-e5c0-4f8b-8617-5e701cd95896 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:57.828571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-303619b0-e5c0-4f8b-8617-5e701cd95896 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:57.952482 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-303619b0-e5c0-4f8b-8617-5e701cd95896 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:57.961929 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-303619b0-e5c0-4f8b-8617-5e701cd95896 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:57.963503 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-303619b0-e5c0-4f8b-8617-5e701cd95896 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:57.964660 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-303619b0-e5c0-4f8b-8617-5e701cd95896 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1736 microversion: 2.20 time: 0.149876 Aug 13 04:36:57.965210 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 613/1204] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:57 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1736 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:36:58.586232 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-ba694433-8b10-4bd5-bc69-bdc50830a0ca req-8d917658-bb21-408c-b4d6-09c9bf4bc5b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f3dbb4-dc66-4923-95f0-d53a986ebf82", "name": "network-vif-plugged", "status": "completed", "tag": "25bafb0e-0d63-4fa6-a942-fc8e07163718"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:36:58.587925 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:36:58.587925 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:36:58.595556 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-ba694433-8b10-4bd5-bc69-bdc50830a0ca req-8d917658-bb21-408c-b4d6-09c9bf4bc5b1 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:58.596004 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-ba694433-8b10-4bd5-bc69-bdc50830a0ca req-8d917658-bb21-408c-b4d6-09c9bf4bc5b1 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:58.608603 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-ba694433-8b10-4bd5-bc69-bdc50830a0ca req-8d917658-bb21-408c-b4d6-09c9bf4bc5b1 service nova] Creating event network-vif-plugged:25bafb0e-0d63-4fa6-a942-fc8e07163718 for instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 on hv-cinder-75996 Aug 13 04:36:58.613477 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-ba694433-8b10-4bd5-bc69-bdc50830a0ca req-8d917658-bb21-408c-b4d6-09c9bf4bc5b1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030849 Aug 13 04:36:58.614081 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 592/1205] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:36:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:36:58.983352 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1002b418-6f47-475b-bdcb-e0e841b5278d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:36:58.984609 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1002b418-6f47-475b-bdcb-e0e841b5278d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:36:58.990811 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1002b418-6f47-475b-bdcb-e0e841b5278d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:58.991265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1002b418-6f47-475b-bdcb-e0e841b5278d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:58.992039 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1002b418-6f47-475b-bdcb-e0e841b5278d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:36:58.992474 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1002b418-6f47-475b-bdcb-e0e841b5278d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:36:59.119412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1002b418-6f47-475b-bdcb-e0e841b5278d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:59.127934 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1002b418-6f47-475b-bdcb-e0e841b5278d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:59.129453 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1002b418-6f47-475b-bdcb-e0e841b5278d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:36:59.130610 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1002b418-6f47-475b-bdcb-e0e841b5278d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1736 microversion: 2.20 time: 0.151055 Aug 13 04:36:59.131165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 614/1206] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:36:58 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1736 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:00.150025 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f78ebf1d-0f86-4b7a-bf5a-69d0c506dde9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:00.152893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f78ebf1d-0f86-4b7a-bf5a-69d0c506dde9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:00.159313 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f78ebf1d-0f86-4b7a-bf5a-69d0c506dde9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:00.159749 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f78ebf1d-0f86-4b7a-bf5a-69d0c506dde9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:00.160850 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f78ebf1d-0f86-4b7a-bf5a-69d0c506dde9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:00.161554 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f78ebf1d-0f86-4b7a-bf5a-69d0c506dde9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:00.299085 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f78ebf1d-0f86-4b7a-bf5a-69d0c506dde9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:00.309731 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f78ebf1d-0f86-4b7a-bf5a-69d0c506dde9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:00.314882 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f78ebf1d-0f86-4b7a-bf5a-69d0c506dde9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:00.316543 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f78ebf1d-0f86-4b7a-bf5a-69d0c506dde9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1736 microversion: 2.20 time: 0.170955 Aug 13 04:37:00.329317 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 593/1207] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:00 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:01.247817 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-360e774f-2ff0-4687-bfba-f8fe6ed3c6fc tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc45ff30dc0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:01.304548 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-360e774f-2ff0-4687-bfba-f8fe6ed3c6fc tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/8b64a611-a4c3-402b-b8e7-cd3a8c3ac704" status: 200 len: 351 microversion: 2.1 time: 0.060343 Aug 13 04:37:01.305327 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 615/1208] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:37:01 2021] GET /compute/v2.1/os-volumes/8b64a611-a4c3-402b-b8e7-cd3a8c3ac704 => generated 351 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:37:01.335838 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7355be8a-d9af-46de-b8c9-181c127e7a5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:01.336446 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7355be8a-d9af-46de-b8c9-181c127e7a5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:01.345143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7355be8a-d9af-46de-b8c9-181c127e7a5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:01.345626 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7355be8a-d9af-46de-b8c9-181c127e7a5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:01.346408 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7355be8a-d9af-46de-b8c9-181c127e7a5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:01.346841 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7355be8a-d9af-46de-b8c9-181c127e7a5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:01.483195 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-572518797", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452", "networks": [{"uuid": "333f6986-dcf0-4bcf-ad96-73e3f328f141"}]}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:01.505148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7355be8a-d9af-46de-b8c9-181c127e7a5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:01.516433 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7355be8a-d9af-46de-b8c9-181c127e7a5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:01.520776 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7355be8a-d9af-46de-b8c9-181c127e7a5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:01.523178 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7355be8a-d9af-46de-b8c9-181c127e7a5a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1736 microversion: 2.20 time: 0.190997 Aug 13 04:37:01.525074 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 594/1209] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:01 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1736 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:01.573990 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.network.neutron [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] validate_networks() for [('333f6986-dcf0-4bcf-ad96-73e3f328f141', None, None, None)] {{(pid=108287) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:37:02.028839 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Flavor limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:37:02.029263 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Image limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:37:02.029771 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Flavor pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:37:02.030179 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Image pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:37:02.030586 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:37:02.040593 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:02.041411 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:02.042467 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:02.043273 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:02.064116 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Getting quotas for project 3e4027fec5f84a06acc7277a243db1d0. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:37:02.068860 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Getting quotas for user 6cb64469c9124316acd8541f394b041a and project 3e4027fec5f84a06acc7277a243db1d0. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:37:02.083077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Going to run 1 instances... {{(pid=108287) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:37:02.085805 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:37:02.143778 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3bcc965b-c9b3-4c39-a714-46191c26be60 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.665606 Aug 13 04:37:02.145134 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 616/1210] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:37:01 2021] POST /compute/v2.1/servers => generated 380 bytes in 668 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Aug 13 04:37:02.155143 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1632f075-21ff-4f26-9b6c-6476cb8465c8 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:02.156387 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1632f075-21ff-4f26-9b6c-6476cb8465c8 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:02.219253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1632f075-21ff-4f26-9b6c-6476cb8465c8 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:02.226316 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1632f075-21ff-4f26-9b6c-6476cb8465c8 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1218 microversion: 2.1 time: 0.075421 Aug 13 04:37:02.227320 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 595/1211] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:02 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1218 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:37:02.542816 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-549c5291-2fff-4f99-916f-dc3110112860 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:02.543483 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-549c5291-2fff-4f99-916f-dc3110112860 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:02.552394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-549c5291-2fff-4f99-916f-dc3110112860 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:02.552863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-549c5291-2fff-4f99-916f-dc3110112860 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:02.553930 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-549c5291-2fff-4f99-916f-dc3110112860 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:02.554393 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-549c5291-2fff-4f99-916f-dc3110112860 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:02.723477 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-549c5291-2fff-4f99-916f-dc3110112860 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:02.742098 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-549c5291-2fff-4f99-916f-dc3110112860 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:02.743774 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-549c5291-2fff-4f99-916f-dc3110112860 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:02.745508 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-549c5291-2fff-4f99-916f-dc3110112860 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1736 microversion: 2.20 time: 0.206217 Aug 13 04:37:02.759346 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 617/1212] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:02 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1736 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:02.759680 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-da64a091-2ccc-4d8b-aa34-ba738bd4d513 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc46c510f70>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:02.822718 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-da64a091-2ccc-4d8b-aa34-ba738bd4d513 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9c6f929c-8147-4c9d-96af-6b3d589c390e" status: 200 len: 351 microversion: 2.1 time: 0.068007 Aug 13 04:37:02.823544 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 596/1213] 10.222.0.13 () {58 vars in 1245 bytes} [Fri Aug 13 04:37:02 2021] GET /compute/v2.1/os-volumes/9c6f929c-8147-4c9d-96af-6b3d589c390e => generated 351 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:37:02.835857 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b30a618f-0991-4c71-b490-d876011083ab tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc45fde4f70>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:02.935279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b30a618f-0991-4c71-b490-d876011083ab tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.102853 Aug 13 04:37:02.941404 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 618/1214] 10.222.0.13 () {58 vars in 1134 bytes} [Fri Aug 13 04:37:02 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:37:02.949365 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e2a6ead6-9692-47e6-9cb0-9a9fcf538166 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc46c5b03a0>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:03.049067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e2a6ead6-9692-47e6-9cb0-9a9fcf538166 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.103217 Aug 13 04:37:03.049999 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 597/1215] 10.222.0.13 () {58 vars in 1149 bytes} [Fri Aug 13 04:37:02 2021] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:37:03.063816 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f44c7b01-b9a9-4034-8019-96c7611c8c0f tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc45fe399d0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:03.155121 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f44c7b01-b9a9-4034-8019-96c7611c8c0f tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.096523 Aug 13 04:37:03.155810 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 619/1216] 10.222.0.13 () {58 vars in 1134 bytes} [Fri Aug 13 04:37:03 2021] GET /compute/v2.1/os-volumes => generated 1035 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:03.168291 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f2811441-3de8-4dd2-81bc-8b4ee5574840 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc46c5f45e0>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:03.248817 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9e5ff6dc-333c-4a6a-aa8f-5f174dfdcbfe tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:03.250096 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9e5ff6dc-333c-4a6a-aa8f-5f174dfdcbfe tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:03.259876 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f2811441-3de8-4dd2-81bc-8b4ee5574840 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.095680 Aug 13 04:37:03.260691 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 598/1217] 10.222.0.13 () {58 vars in 1167 bytes} [Fri Aug 13 04:37:03 2021] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:37:03.277937 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-066e2042-d43c-4287-a579-3ee94baede73 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc46c510af0>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:03.285226 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6dc-333c-4a6a-aa8f-5f174dfdcbfe tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:03.285982 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6dc-333c-4a6a-aa8f-5f174dfdcbfe tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:03.288154 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6dc-333c-4a6a-aa8f-5f174dfdcbfe tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:03.288844 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9e5ff6dc-333c-4a6a-aa8f-5f174dfdcbfe tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:03.427038 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9e5ff6dc-333c-4a6a-aa8f-5f174dfdcbfe tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:03.439918 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9e5ff6dc-333c-4a6a-aa8f-5f174dfdcbfe tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1278 microversion: 2.1 time: 0.198517 Aug 13 04:37:03.456869 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 620/1218] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:03 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1278 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:03.645283 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-066e2042-d43c-4287-a579-3ee94baede73 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.372733 Aug 13 04:37:03.646120 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 599/1219] 10.222.0.13 () {58 vars in 1170 bytes} [Fri Aug 13 04:37:03 2021] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:37:03.658093 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a3ad8295-b242-45a0-8e8d-5e886b1a3643 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc46ca77160>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:03.754996 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a3ad8295-b242-45a0-8e8d-5e886b1a3643 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.100493 Aug 13 04:37:03.758012 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 621/1220] 10.222.0.13 () {58 vars in 1155 bytes} [Fri Aug 13 04:37:03 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:03.769479 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d6dc09c4-05dd-4cde-9624-862084a0f0fc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:03.774287 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d6dc09c4-05dd-4cde-9624-862084a0f0fc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:03.776607 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-2273444c-29b2-4223-92fa-1012ce7b9116 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc45fe398b0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:03.789318 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6dc09c4-05dd-4cde-9624-862084a0f0fc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:03.790216 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6dc09c4-05dd-4cde-9624-862084a0f0fc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:03.792356 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6dc09c4-05dd-4cde-9624-862084a0f0fc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:03.793036 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d6dc09c4-05dd-4cde-9624-862084a0f0fc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:03.878279 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-2273444c-29b2-4223-92fa-1012ce7b9116 tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.110928 Aug 13 04:37:03.879999 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 622/1221] 10.222.0.13 () {58 vars in 1188 bytes} [Fri Aug 13 04:37:03 2021] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:37:03.893892 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-07258bf8-e5f0-46b0-b9eb-26e2a6fbf2ab tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] Calling method '.version_select at 0x7fc45fdb45e0>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:03.976513 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d6dc09c4-05dd-4cde-9624-862084a0f0fc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:03.986329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d6dc09c4-05dd-4cde-9624-862084a0f0fc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:03.989380 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d6dc09c4-05dd-4cde-9624-862084a0f0fc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:03.990848 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d6dc09c4-05dd-4cde-9624-862084a0f0fc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1736 microversion: 2.20 time: 0.227670 Aug 13 04:37:04.002079 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 600/1222] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:03 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:37:04.019850 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-07258bf8-e5f0-46b0-b9eb-26e2a6fbf2ab tempest-VolumesTestJSON-105736887 tempest-VolumesTestJSON-105736887-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.131454 Aug 13 04:37:04.020542 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 623/1223] 10.222.0.13 () {58 vars in 1155 bytes} [Fri Aug 13 04:37:03 2021] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:04.471801 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-69879461-2c98-4b9b-983c-4745517dc3a3 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:04.472531 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-69879461-2c98-4b9b-983c-4745517dc3a3 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:04.486137 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-69879461-2c98-4b9b-983c-4745517dc3a3 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:04.486931 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-69879461-2c98-4b9b-983c-4745517dc3a3 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:04.487977 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-69879461-2c98-4b9b-983c-4745517dc3a3 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:04.488645 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-69879461-2c98-4b9b-983c-4745517dc3a3 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:04.623671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-69879461-2c98-4b9b-983c-4745517dc3a3 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:04.631974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-69879461-2c98-4b9b-983c-4745517dc3a3 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1318 microversion: 2.1 time: 0.163804 Aug 13 04:37:04.633168 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 601/1224] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:04 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:05.008885 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d687a91f-9896-4b78-bedd-08857da768e9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:05.009523 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d687a91f-9896-4b78-bedd-08857da768e9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:05.020328 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d687a91f-9896-4b78-bedd-08857da768e9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:05.022240 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d687a91f-9896-4b78-bedd-08857da768e9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:05.023053 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d687a91f-9896-4b78-bedd-08857da768e9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:05.023493 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d687a91f-9896-4b78-bedd-08857da768e9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:05.200242 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d687a91f-9896-4b78-bedd-08857da768e9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:05.213486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d687a91f-9896-4b78-bedd-08857da768e9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:05.215339 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d687a91f-9896-4b78-bedd-08857da768e9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:05.218504 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d687a91f-9896-4b78-bedd-08857da768e9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1736 microversion: 2.20 time: 0.213244 Aug 13 04:37:05.237388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 624/1225] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:05 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1736 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:05.320148 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-98e2e623-52dc-457d-8396-5f643fd138f0 req-3a5130ac-fe49-41ce-add4-b512489518c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fce62523-4d60-4fb1-bc51-f9481f345237", "tag": "32355f40-b404-4370-9a34-9d340e9a8886"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:05.321837 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:37:05.321837 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:37:05.336514 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-98e2e623-52dc-457d-8396-5f643fd138f0 req-3a5130ac-fe49-41ce-add4-b512489518c9 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:05.337669 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-98e2e623-52dc-457d-8396-5f643fd138f0 req-3a5130ac-fe49-41ce-add4-b512489518c9 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:05.362641 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-98e2e623-52dc-457d-8396-5f643fd138f0 req-3a5130ac-fe49-41ce-add4-b512489518c9 service nova] Creating event network-changed:32355f40-b404-4370-9a34-9d340e9a8886 for instance fce62523-4d60-4fb1-bc51-f9481f345237 on hv-cinder-75996 Aug 13 04:37:05.367942 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-98e2e623-52dc-457d-8396-5f643fd138f0 req-3a5130ac-fe49-41ce-add4-b512489518c9 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052723 Aug 13 04:37:05.368907 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 602/1226] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:37:05 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:37:05.651331 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c306de20-6335-4583-8ab8-be0f5d32550d tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:05.652167 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c306de20-6335-4583-8ab8-be0f5d32550d tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:05.659454 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c306de20-6335-4583-8ab8-be0f5d32550d tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:05.660180 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c306de20-6335-4583-8ab8-be0f5d32550d tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:05.661209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c306de20-6335-4583-8ab8-be0f5d32550d tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:05.661868 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c306de20-6335-4583-8ab8-be0f5d32550d tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:05.837910 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c306de20-6335-4583-8ab8-be0f5d32550d tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:05.848207 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c306de20-6335-4583-8ab8-be0f5d32550d tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1318 microversion: 2.1 time: 0.201381 Aug 13 04:37:05.861274 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 625/1227] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:05 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1318 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:06.241049 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-249e84e2-03c7-4ac7-8d13-6421da4ab7a0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:06.241772 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-249e84e2-03c7-4ac7-8d13-6421da4ab7a0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:06.248719 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-249e84e2-03c7-4ac7-8d13-6421da4ab7a0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:06.255383 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-249e84e2-03c7-4ac7-8d13-6421da4ab7a0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:06.257128 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-249e84e2-03c7-4ac7-8d13-6421da4ab7a0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:06.257601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-249e84e2-03c7-4ac7-8d13-6421da4ab7a0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:06.419591 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-249e84e2-03c7-4ac7-8d13-6421da4ab7a0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:06.429305 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-249e84e2-03c7-4ac7-8d13-6421da4ab7a0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:06.430926 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-249e84e2-03c7-4ac7-8d13-6421da4ab7a0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:06.432099 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-249e84e2-03c7-4ac7-8d13-6421da4ab7a0 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1736 microversion: 2.20 time: 0.196572 Aug 13 04:37:06.477218 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 603/1228] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:06 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1736 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:06.868968 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-bc2dfa03-e8af-4c39-9e2f-b895ef0329fd tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:06.869683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-bc2dfa03-e8af-4c39-9e2f-b895ef0329fd tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:06.876913 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bc2dfa03-e8af-4c39-9e2f-b895ef0329fd tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:06.877624 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bc2dfa03-e8af-4c39-9e2f-b895ef0329fd tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:06.878388 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bc2dfa03-e8af-4c39-9e2f-b895ef0329fd tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:06.878984 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bc2dfa03-e8af-4c39-9e2f-b895ef0329fd tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:07.017082 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-bc2dfa03-e8af-4c39-9e2f-b895ef0329fd tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:07.025471 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-bc2dfa03-e8af-4c39-9e2f-b895ef0329fd tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1318 microversion: 2.1 time: 0.160800 Aug 13 04:37:07.026194 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 626/1229] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:06 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:07.479061 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2e63d100-ebf8-4f30-ad48-451ab8d5015f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:07.480357 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2e63d100-ebf8-4f30-ad48-451ab8d5015f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:07.487221 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e63d100-ebf8-4f30-ad48-451ab8d5015f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:07.487961 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e63d100-ebf8-4f30-ad48-451ab8d5015f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:07.489088 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e63d100-ebf8-4f30-ad48-451ab8d5015f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:07.489791 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2e63d100-ebf8-4f30-ad48-451ab8d5015f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:07.636670 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2e63d100-ebf8-4f30-ad48-451ab8d5015f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:07.650476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2e63d100-ebf8-4f30-ad48-451ab8d5015f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:07.652333 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2e63d100-ebf8-4f30-ad48-451ab8d5015f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:07.653543 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2e63d100-ebf8-4f30-ad48-451ab8d5015f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1736 microversion: 2.20 time: 0.178249 Aug 13 04:37:07.664716 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 604/1230] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:07 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1736 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:08.052158 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3a9292f6-c5d2-4d1f-81e6-683a02ca4f54 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:08.052791 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3a9292f6-c5d2-4d1f-81e6-683a02ca4f54 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:08.074211 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a9292f6-c5d2-4d1f-81e6-683a02ca4f54 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:08.074895 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a9292f6-c5d2-4d1f-81e6-683a02ca4f54 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:08.076055 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a9292f6-c5d2-4d1f-81e6-683a02ca4f54 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:08.076711 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3a9292f6-c5d2-4d1f-81e6-683a02ca4f54 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:08.283244 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3a9292f6-c5d2-4d1f-81e6-683a02ca4f54 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:08.290804 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3a9292f6-c5d2-4d1f-81e6-683a02ca4f54 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1318 microversion: 2.1 time: 0.250219 Aug 13 04:37:08.291395 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 627/1231] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:08 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1318 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:08.672248 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-63c3081f-7bde-49c1-af18-0327b4a2c19d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:08.673674 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-63c3081f-7bde-49c1-af18-0327b4a2c19d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:08.679926 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-63c3081f-7bde-49c1-af18-0327b4a2c19d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:08.680381 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-63c3081f-7bde-49c1-af18-0327b4a2c19d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:08.681530 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-63c3081f-7bde-49c1-af18-0327b4a2c19d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:08.682335 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-63c3081f-7bde-49c1-af18-0327b4a2c19d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:08.838420 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-63c3081f-7bde-49c1-af18-0327b4a2c19d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:08.847814 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-63c3081f-7bde-49c1-af18-0327b4a2c19d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:08.849885 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-63c3081f-7bde-49c1-af18-0327b4a2c19d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:08.851394 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-63c3081f-7bde-49c1-af18-0327b4a2c19d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1736 microversion: 2.20 time: 0.183112 Aug 13 04:37:08.852431 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 605/1232] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:08 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1736 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:09.308084 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-bb5538d2-c39f-4389-83c1-7b8c39ebeb57 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:09.308736 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-bb5538d2-c39f-4389-83c1-7b8c39ebeb57 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:09.318353 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bb5538d2-c39f-4389-83c1-7b8c39ebeb57 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:09.318814 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bb5538d2-c39f-4389-83c1-7b8c39ebeb57 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:09.319595 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bb5538d2-c39f-4389-83c1-7b8c39ebeb57 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:09.320041 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-bb5538d2-c39f-4389-83c1-7b8c39ebeb57 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:09.447770 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-bb5538d2-c39f-4389-83c1-7b8c39ebeb57 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:09.455619 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-bb5538d2-c39f-4389-83c1-7b8c39ebeb57 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1318 microversion: 2.1 time: 0.151193 Aug 13 04:37:09.456193 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 628/1233] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:09 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:09.873824 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-92314b94-30ea-4481-877c-af5dab3b7564 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:09.874463 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-92314b94-30ea-4481-877c-af5dab3b7564 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:09.881535 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-92314b94-30ea-4481-877c-af5dab3b7564 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:09.881988 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-92314b94-30ea-4481-877c-af5dab3b7564 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:09.882777 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-92314b94-30ea-4481-877c-af5dab3b7564 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:09.883322 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-92314b94-30ea-4481-877c-af5dab3b7564 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:10.034585 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-92314b94-30ea-4481-877c-af5dab3b7564 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:10.042940 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-92314b94-30ea-4481-877c-af5dab3b7564 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:10.044784 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-92314b94-30ea-4481-877c-af5dab3b7564 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:10.045959 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-92314b94-30ea-4481-877c-af5dab3b7564 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1718 microversion: 2.20 time: 0.175966 Aug 13 04:37:10.047340 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 606/1234] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:09 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1718 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:10.114499 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-de0cbd66-c580-4404-87c8-bb3ab70a4e41 req-25b32770-baab-42dc-bed1-64b89e48609c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce62523-4d60-4fb1-bc51-f9481f345237", "name": "network-vif-plugged", "status": "completed", "tag": "32355f40-b404-4370-9a34-9d340e9a8886"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:10.116238 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:37:10.116238 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:37:10.123903 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-de0cbd66-c580-4404-87c8-bb3ab70a4e41 req-25b32770-baab-42dc-bed1-64b89e48609c service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:10.124496 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-de0cbd66-c580-4404-87c8-bb3ab70a4e41 req-25b32770-baab-42dc-bed1-64b89e48609c service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:10.137207 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-de0cbd66-c580-4404-87c8-bb3ab70a4e41 req-25b32770-baab-42dc-bed1-64b89e48609c service nova] Creating event network-vif-plugged:32355f40-b404-4370-9a34-9d340e9a8886 for instance fce62523-4d60-4fb1-bc51-f9481f345237 on hv-cinder-75996 Aug 13 04:37:10.143148 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-de0cbd66-c580-4404-87c8-bb3ab70a4e41 req-25b32770-baab-42dc-bed1-64b89e48609c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032724 Aug 13 04:37:10.143737 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 629/1235] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:37:10 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:37:10.471908 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-575acef6-6863-493b-87c5-e79f47be4633 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:10.472734 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-575acef6-6863-493b-87c5-e79f47be4633 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:10.478927 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-575acef6-6863-493b-87c5-e79f47be4633 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:10.479383 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-575acef6-6863-493b-87c5-e79f47be4633 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:10.480166 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-575acef6-6863-493b-87c5-e79f47be4633 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:10.480601 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-575acef6-6863-493b-87c5-e79f47be4633 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:10.615417 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-575acef6-6863-493b-87c5-e79f47be4633 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:10.623987 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-575acef6-6863-493b-87c5-e79f47be4633 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1318 microversion: 2.1 time: 0.155795 Aug 13 04:37:10.629799 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 607/1236] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:10 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:11.065607 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-171fab9f-8d3c-427f-b611-2446490cb24e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:11.066311 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-171fab9f-8d3c-427f-b611-2446490cb24e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:11.072379 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-171fab9f-8d3c-427f-b611-2446490cb24e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:11.072824 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-171fab9f-8d3c-427f-b611-2446490cb24e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:11.073612 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-171fab9f-8d3c-427f-b611-2446490cb24e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:11.074043 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-171fab9f-8d3c-427f-b611-2446490cb24e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:11.214108 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-171fab9f-8d3c-427f-b611-2446490cb24e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:11.223621 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-171fab9f-8d3c-427f-b611-2446490cb24e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:11.225126 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-171fab9f-8d3c-427f-b611-2446490cb24e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:11.226444 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-171fab9f-8d3c-427f-b611-2446490cb24e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1718 microversion: 2.20 time: 0.164799 Aug 13 04:37:11.227251 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 630/1237] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:11 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1718 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:11.640993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d04d3291-2a28-43d7-bb95-8d8fd1c7113e tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:11.641893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d04d3291-2a28-43d7-bb95-8d8fd1c7113e tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:11.648042 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d04d3291-2a28-43d7-bb95-8d8fd1c7113e tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:11.648637 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d04d3291-2a28-43d7-bb95-8d8fd1c7113e tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:11.649594 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d04d3291-2a28-43d7-bb95-8d8fd1c7113e tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:11.650127 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d04d3291-2a28-43d7-bb95-8d8fd1c7113e tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:11.777188 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-d04d3291-2a28-43d7-bb95-8d8fd1c7113e tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:11.788821 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d04d3291-2a28-43d7-bb95-8d8fd1c7113e tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1507 microversion: 2.1 time: 0.152400 Aug 13 04:37:11.798177 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 608/1238] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:11 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1507 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:11.806431 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3c44d5ec-fc69-4bbb-95f1-38b781399d0b tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b501aef7-5b64-4e6d-87ae-a2f5a07ac2bd", "device": "/dev/sdb"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:11.807596 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3c44d5ec-fc69-4bbb-95f1-38b781399d0b tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:11.814807 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3c44d5ec-fc69-4bbb-95f1-38b781399d0b tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:11.815497 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3c44d5ec-fc69-4bbb-95f1-38b781399d0b tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:11.816270 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3c44d5ec-fc69-4bbb-95f1-38b781399d0b tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:11.816697 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3c44d5ec-fc69-4bbb-95f1-38b781399d0b tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:12.071192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3c44d5ec-fc69-4bbb-95f1-38b781399d0b tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "POST /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.268273 Aug 13 04:37:12.072572 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 631/1239] 10.222.0.13 () {60 vars in 1323 bytes} [Fri Aug 13 04:37:11 2021] POST /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:37:12.166294 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-36003aaa-fd6c-4ef2-a139-c67d464e88b7 req-d571de7e-ef4b-4a1a-a006-fff129685e47 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f3dbb4-dc66-4923-95f0-d53a986ebf82", "name": "network-vif-unplugged", "status": "completed", "tag": "25bafb0e-0d63-4fa6-a942-fc8e07163718"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:12.167852 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:37:12.167852 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:37:12.176127 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-36003aaa-fd6c-4ef2-a139-c67d464e88b7 req-d571de7e-ef4b-4a1a-a006-fff129685e47 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:12.176533 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-36003aaa-fd6c-4ef2-a139-c67d464e88b7 req-d571de7e-ef4b-4a1a-a006-fff129685e47 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:12.188493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-36003aaa-fd6c-4ef2-a139-c67d464e88b7 req-d571de7e-ef4b-4a1a-a006-fff129685e47 service nova] Creating event network-vif-unplugged:25bafb0e-0d63-4fa6-a942-fc8e07163718 for instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 on hv-cinder-75996 Aug 13 04:37:12.193979 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-36003aaa-fd6c-4ef2-a139-c67d464e88b7 req-d571de7e-ef4b-4a1a-a006-fff129685e47 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031075 Aug 13 04:37:12.194580 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 609/1240] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:37:12 2021] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:37:12.246804 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-08d2671e-8459-4eec-be77-ad12b926617a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:12.247527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-08d2671e-8459-4eec-be77-ad12b926617a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:12.254309 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-08d2671e-8459-4eec-be77-ad12b926617a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:12.254827 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-08d2671e-8459-4eec-be77-ad12b926617a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:12.255682 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-08d2671e-8459-4eec-be77-ad12b926617a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:12.256166 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-08d2671e-8459-4eec-be77-ad12b926617a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:12.429527 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-08d2671e-8459-4eec-be77-ad12b926617a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:12.438809 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-08d2671e-8459-4eec-be77-ad12b926617a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:12.440446 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-08d2671e-8459-4eec-be77-ad12b926617a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:12.441501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-08d2671e-8459-4eec-be77-ad12b926617a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1718 microversion: 2.20 time: 0.200026 Aug 13 04:37:12.445464 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 632/1241] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:12 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1718 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:13.459568 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-967778eb-c563-4568-b24d-912b2ea88d44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:13.460188 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-967778eb-c563-4568-b24d-912b2ea88d44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:13.466414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-967778eb-c563-4568-b24d-912b2ea88d44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:13.466850 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-967778eb-c563-4568-b24d-912b2ea88d44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:13.467671 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-967778eb-c563-4568-b24d-912b2ea88d44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:13.468073 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-967778eb-c563-4568-b24d-912b2ea88d44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:13.619531 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-967778eb-c563-4568-b24d-912b2ea88d44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:13.627940 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-967778eb-c563-4568-b24d-912b2ea88d44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:13.629478 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-967778eb-c563-4568-b24d-912b2ea88d44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:13.630905 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-967778eb-c563-4568-b24d-912b2ea88d44 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1721 microversion: 2.20 time: 0.175464 Aug 13 04:37:13.631344 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 610/1242] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:13 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:13.648121 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-909e6d9a-6131-4970-924d-d0e8c1724e28 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "49c9bd6e-7782-451f-a463-a5d24c055a4a"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:13.649220 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-909e6d9a-6131-4970-924d-d0e8c1724e28 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:13.656014 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-909e6d9a-6131-4970-924d-d0e8c1724e28 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:13.656466 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-909e6d9a-6131-4970-924d-d0e8c1724e28 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:13.657249 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-909e6d9a-6131-4970-924d-d0e8c1724e28 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:13.657706 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-909e6d9a-6131-4970-924d-d0e8c1724e28 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:13.931906 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-909e6d9a-6131-4970-924d-d0e8c1724e28 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.287439 Aug 13 04:37:13.932512 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 633/1243] 10.222.0.13 () {62 vars in 1364 bytes} [Fri Aug 13 04:37:13 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/os-volume_attachments => generated 188 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Aug 13 04:37:14.061586 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-b7efc308-71eb-4b23-ac37-09e65550af93 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:14.062240 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-b7efc308-71eb-4b23-ac37-09e65550af93 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:14.068267 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b7efc308-71eb-4b23-ac37-09e65550af93 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:14.068893 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b7efc308-71eb-4b23-ac37-09e65550af93 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:14.069685 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b7efc308-71eb-4b23-ac37-09e65550af93 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:14.070122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-b7efc308-71eb-4b23-ac37-09e65550af93 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:14.335084 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-b7efc308-71eb-4b23-ac37-09e65550af93 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/os-volume_attachments/49c9bd6e-7782-451f-a463-a5d24c055a4a" status: 202 len: 0 microversion: 2.20 time: 0.277536 Aug 13 04:37:14.335682 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 611/1244] 10.222.0.13 () {60 vars in 1457 bytes} [Fri Aug 13 04:37:14 2021] DELETE /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/os-volume_attachments/49c9bd6e-7782-451f-a463-a5d24c055a4a => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:37:14.399904 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-6a4ff0ba-aeaf-4f13-bcae-37004a92e6e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:14.400491 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-6a4ff0ba-aeaf-4f13-bcae-37004a92e6e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:14.406965 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a4ff0ba-aeaf-4f13-bcae-37004a92e6e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:14.407416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a4ff0ba-aeaf-4f13-bcae-37004a92e6e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:14.408199 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a4ff0ba-aeaf-4f13-bcae-37004a92e6e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:14.408632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-6a4ff0ba-aeaf-4f13-bcae-37004a92e6e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:14.493296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-6a4ff0ba-aeaf-4f13-bcae-37004a92e6e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action" status: 202 len: 0 microversion: 2.20 time: 0.100107 Aug 13 04:37:14.494138 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 634/1245] 10.222.0.13 () {62 vars in 1319 bytes} [Fri Aug 13 04:37:14 2021] POST /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/action => generated 0 bytes in 102 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:37:14.504575 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1f4a5ecb-19b1-42ea-8a2a-4977f2552cd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:14.506070 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1f4a5ecb-19b1-42ea-8a2a-4977f2552cd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:14.512534 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1f4a5ecb-19b1-42ea-8a2a-4977f2552cd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:14.513071 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1f4a5ecb-19b1-42ea-8a2a-4977f2552cd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:14.513861 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1f4a5ecb-19b1-42ea-8a2a-4977f2552cd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:14.514374 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1f4a5ecb-19b1-42ea-8a2a-4977f2552cd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:14.651144 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1f4a5ecb-19b1-42ea-8a2a-4977f2552cd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:14.661173 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1f4a5ecb-19b1-42ea-8a2a-4977f2552cd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:14.662740 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1f4a5ecb-19b1-42ea-8a2a-4977f2552cd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:14.663886 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1f4a5ecb-19b1-42ea-8a2a-4977f2552cd9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1669 microversion: 2.20 time: 0.163150 Aug 13 04:37:14.664476 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 612/1246] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:14 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1669 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:15.683046 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-be27fea1-736b-4048-80e3-eba906299d80 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:15.683658 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-be27fea1-736b-4048-80e3-eba906299d80 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:15.689819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-be27fea1-736b-4048-80e3-eba906299d80 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:15.690268 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-be27fea1-736b-4048-80e3-eba906299d80 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:15.691043 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-be27fea1-736b-4048-80e3-eba906299d80 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:15.691481 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-be27fea1-736b-4048-80e3-eba906299d80 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:15.819979 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-be27fea1-736b-4048-80e3-eba906299d80 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:15.829691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-be27fea1-736b-4048-80e3-eba906299d80 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:15.831468 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-be27fea1-736b-4048-80e3-eba906299d80 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:15.832632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-be27fea1-736b-4048-80e3-eba906299d80 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.153826 Aug 13 04:37:15.833345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 635/1247] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:15 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:16.851933 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-33129184-793b-4885-9293-e78c1de0f4a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:16.852642 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-33129184-793b-4885-9293-e78c1de0f4a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:16.859801 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-33129184-793b-4885-9293-e78c1de0f4a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:16.860307 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-33129184-793b-4885-9293-e78c1de0f4a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:16.861091 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-33129184-793b-4885-9293-e78c1de0f4a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:16.861566 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-33129184-793b-4885-9293-e78c1de0f4a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:16.988908 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-33129184-793b-4885-9293-e78c1de0f4a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:16.997320 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-33129184-793b-4885-9293-e78c1de0f4a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:16.998862 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-33129184-793b-4885-9293-e78c1de0f4a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:17.000046 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-33129184-793b-4885-9293-e78c1de0f4a1 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.152262 Aug 13 04:37:17.000656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 613/1248] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:16 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:18.019146 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-43bec557-831a-4437-b066-31df0062cee4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:18.019753 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-43bec557-831a-4437-b066-31df0062cee4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:18.025819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-43bec557-831a-4437-b066-31df0062cee4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:18.026495 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-43bec557-831a-4437-b066-31df0062cee4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:18.027437 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-43bec557-831a-4437-b066-31df0062cee4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:18.028119 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-43bec557-831a-4437-b066-31df0062cee4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:18.174692 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-43bec557-831a-4437-b066-31df0062cee4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:18.182998 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-43bec557-831a-4437-b066-31df0062cee4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:18.184478 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-43bec557-831a-4437-b066-31df0062cee4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:18.185911 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-43bec557-831a-4437-b066-31df0062cee4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.171613 Aug 13 04:37:18.186501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 636/1249] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:18 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:19.204451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2aee5199-395f-4015-8a99-eae75ce18085 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:19.205200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2aee5199-395f-4015-8a99-eae75ce18085 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:19.211549 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2aee5199-395f-4015-8a99-eae75ce18085 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:19.211993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2aee5199-395f-4015-8a99-eae75ce18085 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:19.212764 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2aee5199-395f-4015-8a99-eae75ce18085 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:19.213196 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2aee5199-395f-4015-8a99-eae75ce18085 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:19.356336 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2aee5199-395f-4015-8a99-eae75ce18085 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:19.367359 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2aee5199-395f-4015-8a99-eae75ce18085 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:19.368898 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2aee5199-395f-4015-8a99-eae75ce18085 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:19.370308 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2aee5199-395f-4015-8a99-eae75ce18085 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.169888 Aug 13 04:37:19.370864 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 614/1250] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:19 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:20.389116 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d6d7fce8-7f1e-4034-9811-0dd3b54842e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:20.389805 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d6d7fce8-7f1e-4034-9811-0dd3b54842e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:20.396517 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d6d7fce8-7f1e-4034-9811-0dd3b54842e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:20.397138 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d6d7fce8-7f1e-4034-9811-0dd3b54842e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:20.397863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d6d7fce8-7f1e-4034-9811-0dd3b54842e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:20.398531 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d6d7fce8-7f1e-4034-9811-0dd3b54842e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:20.534952 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d6d7fce8-7f1e-4034-9811-0dd3b54842e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:20.544067 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d6d7fce8-7f1e-4034-9811-0dd3b54842e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:20.545978 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d6d7fce8-7f1e-4034-9811-0dd3b54842e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:20.547505 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d6d7fce8-7f1e-4034-9811-0dd3b54842e6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.162119 Aug 13 04:37:20.548045 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 637/1251] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:20 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:21.565317 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2b1b40c6-1b28-446f-b852-18530598992a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:21.566010 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2b1b40c6-1b28-446f-b852-18530598992a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:21.572469 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2b1b40c6-1b28-446f-b852-18530598992a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:21.573003 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2b1b40c6-1b28-446f-b852-18530598992a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:21.573896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2b1b40c6-1b28-446f-b852-18530598992a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:21.574422 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2b1b40c6-1b28-446f-b852-18530598992a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:21.703301 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2b1b40c6-1b28-446f-b852-18530598992a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:21.711565 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2b1b40c6-1b28-446f-b852-18530598992a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:21.713149 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2b1b40c6-1b28-446f-b852-18530598992a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:21.714460 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2b1b40c6-1b28-446f-b852-18530598992a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.153028 Aug 13 04:37:21.715323 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 615/1252] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:21 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:22.732885 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-61f65500-d41e-48ae-9c82-96c4fa400244 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:22.734258 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-61f65500-d41e-48ae-9c82-96c4fa400244 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:22.740875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-61f65500-d41e-48ae-9c82-96c4fa400244 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:22.741324 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-61f65500-d41e-48ae-9c82-96c4fa400244 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:22.742112 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-61f65500-d41e-48ae-9c82-96c4fa400244 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:22.742544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-61f65500-d41e-48ae-9c82-96c4fa400244 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:22.878531 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-61f65500-d41e-48ae-9c82-96c4fa400244 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:22.887079 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-61f65500-d41e-48ae-9c82-96c4fa400244 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:22.888857 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-61f65500-d41e-48ae-9c82-96c4fa400244 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:22.890863 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-61f65500-d41e-48ae-9c82-96c4fa400244 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.161637 Aug 13 04:37:22.891601 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 638/1253] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:22 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:23.909451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-9c8059d6-45fb-4b83-9c4a-dba8f1721aad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:23.910131 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-9c8059d6-45fb-4b83-9c4a-dba8f1721aad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:23.917414 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c8059d6-45fb-4b83-9c4a-dba8f1721aad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:23.917890 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c8059d6-45fb-4b83-9c4a-dba8f1721aad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:23.918704 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c8059d6-45fb-4b83-9c4a-dba8f1721aad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:23.919138 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-9c8059d6-45fb-4b83-9c4a-dba8f1721aad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:24.052826 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9c8059d6-45fb-4b83-9c4a-dba8f1721aad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:24.060840 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9c8059d6-45fb-4b83-9c4a-dba8f1721aad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:24.062762 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-9c8059d6-45fb-4b83-9c4a-dba8f1721aad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:24.063948 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-9c8059d6-45fb-4b83-9c4a-dba8f1721aad tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.158583 Aug 13 04:37:24.064531 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 616/1254] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:23 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:25.082592 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-687b21ef-e7eb-4adb-ac99-cc8fdcbddc02 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:25.083246 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-687b21ef-e7eb-4adb-ac99-cc8fdcbddc02 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:25.089156 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-687b21ef-e7eb-4adb-ac99-cc8fdcbddc02 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:25.089642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-687b21ef-e7eb-4adb-ac99-cc8fdcbddc02 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:25.090403 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-687b21ef-e7eb-4adb-ac99-cc8fdcbddc02 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:25.090894 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-687b21ef-e7eb-4adb-ac99-cc8fdcbddc02 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:25.216339 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-687b21ef-e7eb-4adb-ac99-cc8fdcbddc02 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:25.225114 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-687b21ef-e7eb-4adb-ac99-cc8fdcbddc02 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:25.226644 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-687b21ef-e7eb-4adb-ac99-cc8fdcbddc02 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:25.227789 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-687b21ef-e7eb-4adb-ac99-cc8fdcbddc02 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.148929 Aug 13 04:37:25.228692 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 639/1255] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:25 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:26.247645 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-bc856b64-f5ec-4f52-b214-aab5c79bfb2e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:26.248219 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-bc856b64-f5ec-4f52-b214-aab5c79bfb2e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:26.255605 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bc856b64-f5ec-4f52-b214-aab5c79bfb2e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:26.256051 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bc856b64-f5ec-4f52-b214-aab5c79bfb2e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:26.256855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bc856b64-f5ec-4f52-b214-aab5c79bfb2e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:26.257287 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-bc856b64-f5ec-4f52-b214-aab5c79bfb2e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:26.394133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bc856b64-f5ec-4f52-b214-aab5c79bfb2e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:26.402839 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bc856b64-f5ec-4f52-b214-aab5c79bfb2e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:26.404342 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-bc856b64-f5ec-4f52-b214-aab5c79bfb2e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:26.405548 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-bc856b64-f5ec-4f52-b214-aab5c79bfb2e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.161990 Aug 13 04:37:26.406312 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 617/1256] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:26 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:27.424207 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-a6a6b220-26f2-4431-8e2b-2f6d4f7fab8d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:27.424819 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-a6a6b220-26f2-4431-8e2b-2f6d4f7fab8d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:27.430818 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a6a6b220-26f2-4431-8e2b-2f6d4f7fab8d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:27.431265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a6a6b220-26f2-4431-8e2b-2f6d4f7fab8d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:27.432028 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a6a6b220-26f2-4431-8e2b-2f6d4f7fab8d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:27.432463 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-a6a6b220-26f2-4431-8e2b-2f6d4f7fab8d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:27.557544 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a6a6b220-26f2-4431-8e2b-2f6d4f7fab8d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:27.566770 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a6a6b220-26f2-4431-8e2b-2f6d4f7fab8d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:27.568255 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-a6a6b220-26f2-4431-8e2b-2f6d4f7fab8d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:27.569394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-a6a6b220-26f2-4431-8e2b-2f6d4f7fab8d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.149575 Aug 13 04:37:27.569970 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 640/1257] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:27 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:28.587939 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-55077e6c-bbe1-4d26-9a0c-5af8930db7bb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:28.588577 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-55077e6c-bbe1-4d26-9a0c-5af8930db7bb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:28.595619 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-55077e6c-bbe1-4d26-9a0c-5af8930db7bb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:28.596073 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-55077e6c-bbe1-4d26-9a0c-5af8930db7bb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:28.596874 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-55077e6c-bbe1-4d26-9a0c-5af8930db7bb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:28.597304 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-55077e6c-bbe1-4d26-9a0c-5af8930db7bb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:28.734276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-55077e6c-bbe1-4d26-9a0c-5af8930db7bb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:28.743216 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-55077e6c-bbe1-4d26-9a0c-5af8930db7bb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:28.744757 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-55077e6c-bbe1-4d26-9a0c-5af8930db7bb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:28.745904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-55077e6c-bbe1-4d26-9a0c-5af8930db7bb tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.161723 Aug 13 04:37:28.746463 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 618/1258] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:28 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:29.764002 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-05d832c3-af24-49fe-ace2-33ee9e7d99d3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:29.764621 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-05d832c3-af24-49fe-ace2-33ee9e7d99d3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:29.771244 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-05d832c3-af24-49fe-ace2-33ee9e7d99d3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:29.771701 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-05d832c3-af24-49fe-ace2-33ee9e7d99d3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:29.772476 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-05d832c3-af24-49fe-ace2-33ee9e7d99d3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:29.772917 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-05d832c3-af24-49fe-ace2-33ee9e7d99d3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:29.899924 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-05d832c3-af24-49fe-ace2-33ee9e7d99d3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:29.907579 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-05d832c3-af24-49fe-ace2-33ee9e7d99d3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:29.909052 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-05d832c3-af24-49fe-ace2-33ee9e7d99d3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:29.910208 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-05d832c3-af24-49fe-ace2-33ee9e7d99d3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.150065 Aug 13 04:37:29.910752 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 641/1259] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:29 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:30.928048 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-86530eb7-122e-4c86-bfcd-daffa93dcecc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:30.928913 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-86530eb7-122e-4c86-bfcd-daffa93dcecc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:30.934994 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-86530eb7-122e-4c86-bfcd-daffa93dcecc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:30.935526 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-86530eb7-122e-4c86-bfcd-daffa93dcecc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:30.936356 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-86530eb7-122e-4c86-bfcd-daffa93dcecc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:30.936853 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-86530eb7-122e-4c86-bfcd-daffa93dcecc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:31.068865 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-86530eb7-122e-4c86-bfcd-daffa93dcecc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:31.076557 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-86530eb7-122e-4c86-bfcd-daffa93dcecc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:31.078085 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-86530eb7-122e-4c86-bfcd-daffa93dcecc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:31.079999 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-86530eb7-122e-4c86-bfcd-daffa93dcecc tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.155782 Aug 13 04:37:31.080588 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 619/1260] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:30 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:32.098624 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-20bd6b60-9874-40fe-9833-6c4c0a83fe4e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:32.099218 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-20bd6b60-9874-40fe-9833-6c4c0a83fe4e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:32.105213 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20bd6b60-9874-40fe-9833-6c4c0a83fe4e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:32.105813 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20bd6b60-9874-40fe-9833-6c4c0a83fe4e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:32.106681 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20bd6b60-9874-40fe-9833-6c4c0a83fe4e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:32.107237 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-20bd6b60-9874-40fe-9833-6c4c0a83fe4e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:32.232730 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-20bd6b60-9874-40fe-9833-6c4c0a83fe4e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:32.240823 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-20bd6b60-9874-40fe-9833-6c4c0a83fe4e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:32.242341 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-20bd6b60-9874-40fe-9833-6c4c0a83fe4e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:32.243491 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-20bd6b60-9874-40fe-9833-6c4c0a83fe4e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.149407 Aug 13 04:37:32.244077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 642/1261] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:32 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:33.261385 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-502dcb7f-0ff3-4ddf-bb1c-4d144f65ba94 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:33.262022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-502dcb7f-0ff3-4ddf-bb1c-4d144f65ba94 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:33.268045 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-502dcb7f-0ff3-4ddf-bb1c-4d144f65ba94 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:33.268486 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-502dcb7f-0ff3-4ddf-bb1c-4d144f65ba94 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:33.269253 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-502dcb7f-0ff3-4ddf-bb1c-4d144f65ba94 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:33.269715 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-502dcb7f-0ff3-4ddf-bb1c-4d144f65ba94 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:33.394267 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-502dcb7f-0ff3-4ddf-bb1c-4d144f65ba94 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:33.401981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-502dcb7f-0ff3-4ddf-bb1c-4d144f65ba94 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:33.403478 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-502dcb7f-0ff3-4ddf-bb1c-4d144f65ba94 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:33.404609 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-502dcb7f-0ff3-4ddf-bb1c-4d144f65ba94 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.147130 Aug 13 04:37:33.405163 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 620/1262] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:33 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:34.423920 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-dee6304c-b453-4b4a-9177-15bc5092116d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:34.424535 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-dee6304c-b453-4b4a-9177-15bc5092116d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:34.430470 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dee6304c-b453-4b4a-9177-15bc5092116d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:34.430931 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dee6304c-b453-4b4a-9177-15bc5092116d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:34.431690 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dee6304c-b453-4b4a-9177-15bc5092116d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:34.432129 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-dee6304c-b453-4b4a-9177-15bc5092116d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:34.558721 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dee6304c-b453-4b4a-9177-15bc5092116d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:34.567299 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dee6304c-b453-4b4a-9177-15bc5092116d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:34.568792 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-dee6304c-b453-4b4a-9177-15bc5092116d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:34.570043 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-dee6304c-b453-4b4a-9177-15bc5092116d tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.150503 Aug 13 04:37:34.570594 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 643/1263] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:34 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Aug 13 04:37:35.588490 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2c03254c-ca16-48c2-a228-7a9b1035c2f2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:35.589913 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2c03254c-ca16-48c2-a228-7a9b1035c2f2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:35.596298 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c03254c-ca16-48c2-a228-7a9b1035c2f2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:35.597065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c03254c-ca16-48c2-a228-7a9b1035c2f2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:35.597897 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c03254c-ca16-48c2-a228-7a9b1035c2f2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:35.598337 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c03254c-ca16-48c2-a228-7a9b1035c2f2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:35.740773 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2c03254c-ca16-48c2-a228-7a9b1035c2f2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:35.748445 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2c03254c-ca16-48c2-a228-7a9b1035c2f2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:35.749963 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2c03254c-ca16-48c2-a228-7a9b1035c2f2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:35.751067 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2c03254c-ca16-48c2-a228-7a9b1035c2f2 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.166733 Aug 13 04:37:35.752506 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 621/1264] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:35 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:36.769667 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-3b76ce81-07d2-444f-85eb-43eea071046f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:36.770267 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-3b76ce81-07d2-444f-85eb-43eea071046f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:36.776926 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b76ce81-07d2-444f-85eb-43eea071046f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:36.777370 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b76ce81-07d2-444f-85eb-43eea071046f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:36.778231 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b76ce81-07d2-444f-85eb-43eea071046f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:36.778657 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-3b76ce81-07d2-444f-85eb-43eea071046f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:36.899730 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3b76ce81-07d2-444f-85eb-43eea071046f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:36.908080 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3b76ce81-07d2-444f-85eb-43eea071046f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:36.909664 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-3b76ce81-07d2-444f-85eb-43eea071046f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:36.910792 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-3b76ce81-07d2-444f-85eb-43eea071046f tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.144896 Aug 13 04:37:36.911350 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 644/1265] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:36 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:37.928946 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-08bd0617-1a13-4def-ba46-2e3d56d431c6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:37.932894 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-08bd0617-1a13-4def-ba46-2e3d56d431c6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:37.937893 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-bb96d33d-7e17-4009-a71e-11b60ebbf9dd req-a7416595-5c8c-4319-9c0f-6ccadb92768b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f3dbb4-dc66-4923-95f0-d53a986ebf82", "name": "network-vif-plugged", "status": "completed", "tag": "25bafb0e-0d63-4fa6-a942-fc8e07163718"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:37.940724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:37:37.940724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:37:37.943249 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-08bd0617-1a13-4def-ba46-2e3d56d431c6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:37.943819 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-08bd0617-1a13-4def-ba46-2e3d56d431c6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:37.944768 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-08bd0617-1a13-4def-ba46-2e3d56d431c6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:37.945252 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-08bd0617-1a13-4def-ba46-2e3d56d431c6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:37.948195 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-bb96d33d-7e17-4009-a71e-11b60ebbf9dd req-a7416595-5c8c-4319-9c0f-6ccadb92768b service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:37.948868 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-bb96d33d-7e17-4009-a71e-11b60ebbf9dd req-a7416595-5c8c-4319-9c0f-6ccadb92768b service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:37.962197 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-bb96d33d-7e17-4009-a71e-11b60ebbf9dd req-a7416595-5c8c-4319-9c0f-6ccadb92768b service nova] Creating event network-vif-plugged:25bafb0e-0d63-4fa6-a942-fc8e07163718 for instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 on hv-cinder-75996 Aug 13 04:37:37.967835 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-bb96d33d-7e17-4009-a71e-11b60ebbf9dd req-a7416595-5c8c-4319-9c0f-6ccadb92768b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033812 Aug 13 04:37:37.968655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 645/1266] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:37:37 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:37:38.101439 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-08bd0617-1a13-4def-ba46-2e3d56d431c6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:38.109147 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-08bd0617-1a13-4def-ba46-2e3d56d431c6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:38.110860 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-08bd0617-1a13-4def-ba46-2e3d56d431c6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:38.112163 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-08bd0617-1a13-4def-ba46-2e3d56d431c6 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.186939 Aug 13 04:37:38.112645 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 622/1267] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:37 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:39.133063 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e9e19795-2ebc-4762-94f8-be066ab5d5e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:39.133802 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e9e19795-2ebc-4762-94f8-be066ab5d5e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:39.139821 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e9e19795-2ebc-4762-94f8-be066ab5d5e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:39.140271 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e9e19795-2ebc-4762-94f8-be066ab5d5e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:39.141140 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e9e19795-2ebc-4762-94f8-be066ab5d5e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:39.141488 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e9e19795-2ebc-4762-94f8-be066ab5d5e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:39.278770 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e9e19795-2ebc-4762-94f8-be066ab5d5e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:39.287830 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e9e19795-2ebc-4762-94f8-be066ab5d5e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:39.289322 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-e9e19795-2ebc-4762-94f8-be066ab5d5e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:39.290490 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e9e19795-2ebc-4762-94f8-be066ab5d5e4 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.161987 Aug 13 04:37:39.291044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 646/1268] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:39 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:40.308465 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-97b2d91b-8f18-4225-a416-84fe77f79ba3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:40.309168 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-97b2d91b-8f18-4225-a416-84fe77f79ba3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:40.316392 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97b2d91b-8f18-4225-a416-84fe77f79ba3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:40.316841 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97b2d91b-8f18-4225-a416-84fe77f79ba3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:40.317686 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97b2d91b-8f18-4225-a416-84fe77f79ba3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:40.318118 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-97b2d91b-8f18-4225-a416-84fe77f79ba3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:40.461036 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-97b2d91b-8f18-4225-a416-84fe77f79ba3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:40.475046 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-97b2d91b-8f18-4225-a416-84fe77f79ba3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:40.477739 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-97b2d91b-8f18-4225-a416-84fe77f79ba3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:40.479685 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-97b2d91b-8f18-4225-a416-84fe77f79ba3 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1727 microversion: 2.20 time: 0.174786 Aug 13 04:37:40.480628 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 623/1269] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:40 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1727 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:41.498392 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7089b0e8-a18c-4995-8262-469075c83e7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:41.499188 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7089b0e8-a18c-4995-8262-469075c83e7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:41.506006 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7089b0e8-a18c-4995-8262-469075c83e7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:41.506515 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7089b0e8-a18c-4995-8262-469075c83e7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:41.507509 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7089b0e8-a18c-4995-8262-469075c83e7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:41.508182 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7089b0e8-a18c-4995-8262-469075c83e7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:41.630351 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7089b0e8-a18c-4995-8262-469075c83e7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:41.643808 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7089b0e8-a18c-4995-8262-469075c83e7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:41.645346 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-7089b0e8-a18c-4995-8262-469075c83e7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:41.646528 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7089b0e8-a18c-4995-8262-469075c83e7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1714 microversion: 2.20 time: 0.151964 Aug 13 04:37:41.647298 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 647/1270] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:37:41 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1714 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:37:43.073635 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ad595b55-1e7a-49ad-aafd-48cd56589fc6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:43.074169 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ad595b55-1e7a-49ad-aafd-48cd56589fc6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:43.080737 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ad595b55-1e7a-49ad-aafd-48cd56589fc6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:43.081185 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ad595b55-1e7a-49ad-aafd-48cd56589fc6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:43.081996 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ad595b55-1e7a-49ad-aafd-48cd56589fc6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:43.082434 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ad595b55-1e7a-49ad-aafd-48cd56589fc6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:43.166784 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-ad595b55-1e7a-49ad-aafd-48cd56589fc6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lazy-loading 'services' on Instance uuid fce62523-4d60-4fb1-bc51-f9481f345237 {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:37:43.231970 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ad595b55-1e7a-49ad-aafd-48cd56589fc6 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237/os-volume_attachments/b501aef7-5b64-4e6d-87ae-a2f5a07ac2bd" status: 202 len: 0 microversion: 2.1 time: 0.162093 Aug 13 04:37:43.232583 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 624/1271] 10.222.0.13 () {58 vars in 1416 bytes} [Fri Aug 13 04:37:43 2021] DELETE /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237/os-volume_attachments/b501aef7-5b64-4e6d-87ae-a2f5a07ac2bd => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:37:44.351734 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-fd9a7463-3ce3-4cd1-9633-b93804baed24 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:44.352233 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-fd9a7463-3ce3-4cd1-9633-b93804baed24 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:44.358112 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fd9a7463-3ce3-4cd1-9633-b93804baed24 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:44.358557 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fd9a7463-3ce3-4cd1-9633-b93804baed24 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:44.359321 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fd9a7463-3ce3-4cd1-9633-b93804baed24 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:44.359748 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-fd9a7463-3ce3-4cd1-9633-b93804baed24 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:44.386955 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-fd9a7463-3ce3-4cd1-9633-b93804baed24 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:37:44.465300 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-fd9a7463-3ce3-4cd1-9633-b93804baed24 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "DELETE /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 204 len: 0 microversion: 2.1 time: 0.116885 Aug 13 04:37:44.469100 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 648/1272] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:37:44 2021] DELETE /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:37:44.475205 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-eae70696-bb30-470f-9ff0-034c462b8cea tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:44.475897 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-eae70696-bb30-470f-9ff0-034c462b8cea tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:44.482037 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eae70696-bb30-470f-9ff0-034c462b8cea tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:44.482489 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eae70696-bb30-470f-9ff0-034c462b8cea tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:44.483292 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eae70696-bb30-470f-9ff0-034c462b8cea tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:44.483728 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-eae70696-bb30-470f-9ff0-034c462b8cea tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:44.612514 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-eae70696-bb30-470f-9ff0-034c462b8cea tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:44.620180 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-eae70696-bb30-470f-9ff0-034c462b8cea tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1513 microversion: 2.1 time: 0.149021 Aug 13 04:37:44.620757 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 625/1273] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:44 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:45.641683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4053f119-00d5-4952-8c03-13babfa003e1 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:45.642949 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4053f119-00d5-4952-8c03-13babfa003e1 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:45.648773 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4053f119-00d5-4952-8c03-13babfa003e1 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:45.649218 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4053f119-00d5-4952-8c03-13babfa003e1 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:45.650009 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4053f119-00d5-4952-8c03-13babfa003e1 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:45.650440 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4053f119-00d5-4952-8c03-13babfa003e1 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:45.788256 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-4053f119-00d5-4952-8c03-13babfa003e1 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:45.795581 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4053f119-00d5-4952-8c03-13babfa003e1 tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1513 microversion: 2.1 time: 0.160722 Aug 13 04:37:45.796159 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 649/1274] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:45 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1513 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:46.812100 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-58836c76-5b1e-49e6-87e3-e55374e24b6c tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:46.812711 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-58836c76-5b1e-49e6-87e3-e55374e24b6c tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:46.819705 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-58836c76-5b1e-49e6-87e3-e55374e24b6c tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:46.820147 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-58836c76-5b1e-49e6-87e3-e55374e24b6c tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:46.820914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-58836c76-5b1e-49e6-87e3-e55374e24b6c tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:46.821359 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-58836c76-5b1e-49e6-87e3-e55374e24b6c tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:46.888292 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-58836c76-5b1e-49e6-87e3-e55374e24b6c tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6cb64469c9124316acd8541f394b041a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3e4027fec5f84a06acc7277a243db1d0', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:46.902160 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-58836c76-5b1e-49e6-87e3-e55374e24b6c tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 200 len: 1471 microversion: 2.1 time: 0.089577 Aug 13 04:37:46.902809 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 626/1275] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:46 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 1471 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:46.949014 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-dfe59e86-7186-46b4-ab13-ecf4f8a3a8ab req-9f2370ad-0ada-46df-9b1d-2b099f6016fe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fce62523-4d60-4fb1-bc51-f9481f345237", "name": "network-vif-deleted", "tag": "32355f40-b404-4370-9a34-9d340e9a8886"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:46.950555 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:37:46.950555 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:37:46.957589 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-dfe59e86-7186-46b4-ab13-ecf4f8a3a8ab req-9f2370ad-0ada-46df-9b1d-2b099f6016fe service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:46.958025 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-dfe59e86-7186-46b4-ab13-ecf4f8a3a8ab req-9f2370ad-0ada-46df-9b1d-2b099f6016fe service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:46.970076 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-dfe59e86-7186-46b4-ab13-ecf4f8a3a8ab req-9f2370ad-0ada-46df-9b1d-2b099f6016fe service nova] Creating event network-vif-deleted:32355f40-b404-4370-9a34-9d340e9a8886 for instance fce62523-4d60-4fb1-bc51-f9481f345237 on hv-cinder-75996 Aug 13 04:37:46.976102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-dfe59e86-7186-46b4-ab13-ecf4f8a3a8ab req-9f2370ad-0ada-46df-9b1d-2b099f6016fe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030317 Aug 13 04:37:46.977558 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 650/1276] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:37:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:37:47.918629 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5f2081c4-3917-4842-8982-b6aae8b9775f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:47.919255 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5f2081c4-3917-4842-8982-b6aae8b9775f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] [instance: fce62523-4d60-4fb1-bc51-f9481f345237] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:47.925782 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5f2081c4-3917-4842-8982-b6aae8b9775f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:47.926231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5f2081c4-3917-4842-8982-b6aae8b9775f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:47.926993 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5f2081c4-3917-4842-8982-b6aae8b9775f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:47.927427 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5f2081c4-3917-4842-8982-b6aae8b9775f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:47.941184 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-5f2081c4-3917-4842-8982-b6aae8b9775f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] HTTP exception thrown: Instance fce62523-4d60-4fb1-bc51-f9481f345237 could not be found. Aug 13 04:37:47.941793 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5f2081c4-3917-4842-8982-b6aae8b9775f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] Returning 404 to user: Instance fce62523-4d60-4fb1-bc51-f9481f345237 could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:37:47.942610 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5f2081c4-3917-4842-8982-b6aae8b9775f tempest-VolumesSnapshotTestJSON-1605375025 tempest-VolumesSnapshotTestJSON-1605375025-project] 10.222.0.13 "GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237" status: 404 len: 111 microversion: 2.1 time: 0.027707 Aug 13 04:37:47.943113 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 627/1277] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:47 2021] GET /compute/v2.1/servers/fce62523-4d60-4fb1-bc51-f9481f345237 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:37:48.355146 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1739916065", "imageRef": "c99895dc-5e55-450a-81ce-dcaf84459890", "flavorRef": "452"}} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:48.406296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.network.neutron [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] validate_networks() for None {{(pid=108287) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:37:48.678165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Flavor limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:37:48.678611 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Image limits 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:37:48.679132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Flavor pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:37:48.679751 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Image pref 0:0:0 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:37:48.680252 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.virt.hardware [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108287) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:37:48.690014 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:48.690461 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:48.691259 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:48.691691 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:48.708107 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Getting quotas for project 784971d178e449a7b8af2b8d2043b108. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:37:48.711969 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.quota [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Getting quotas for user bfc60032f246408b8d8512b87977bd92 and project 784971d178e449a7b8af2b8d2043b108. Resources: {'cores', 'instances', 'ram'} {{(pid=108287) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:37:48.722415 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Going to run 1 instances... {{(pid=108287) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:37:48.724770 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='c99895dc-5e55-450a-81ce-dcaf84459890',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=108287) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:37:48.770797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-7831cf14-dd4b-4e15-b227-23be4488e7c3 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.419549 Aug 13 04:37:48.771449 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 651/1278] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:37:48 2021] POST /compute/v2.1/servers => generated 380 bytes in 421 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:37:48.781560 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4b4cfa20-aebc-489b-8958-503adeb4ffc5 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:48.782695 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4b4cfa20-aebc-489b-8958-503adeb4ffc5 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:48.833408 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-4b4cfa20-aebc-489b-8958-503adeb4ffc5 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:48.839912 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4b4cfa20-aebc-489b-8958-503adeb4ffc5 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1215 microversion: 2.1 time: 0.062124 Aug 13 04:37:48.840469 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 628/1279] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:48 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1215 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:49.856642 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-30bb69ba-6112-46ab-bf98-7d4e70ee0b6e tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:49.857262 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-30bb69ba-6112-46ab-bf98-7d4e70ee0b6e tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:49.863486 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-30bb69ba-6112-46ab-bf98-7d4e70ee0b6e tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:49.863936 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-30bb69ba-6112-46ab-bf98-7d4e70ee0b6e tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:49.864703 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-30bb69ba-6112-46ab-bf98-7d4e70ee0b6e tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:49.865137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-30bb69ba-6112-46ab-bf98-7d4e70ee0b6e tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:49.924740 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-30bb69ba-6112-46ab-bf98-7d4e70ee0b6e tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:49.931955 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-30bb69ba-6112-46ab-bf98-7d4e70ee0b6e tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1275 microversion: 2.1 time: 0.079022 Aug 13 04:37:49.932511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 652/1280] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:49 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1275 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:50.949289 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-92822bd1-7d19-4ed9-9756-aca3daf6a95b tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:50.950070 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-92822bd1-7d19-4ed9-9756-aca3daf6a95b tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:50.956816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-92822bd1-7d19-4ed9-9756-aca3daf6a95b tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:50.957261 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-92822bd1-7d19-4ed9-9756-aca3daf6a95b tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:50.958075 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-92822bd1-7d19-4ed9-9756-aca3daf6a95b tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:50.958509 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-92822bd1-7d19-4ed9-9756-aca3daf6a95b tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:51.017249 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-92822bd1-7d19-4ed9-9756-aca3daf6a95b tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:51.024470 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-92822bd1-7d19-4ed9-9756-aca3daf6a95b tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1275 microversion: 2.1 time: 0.078879 Aug 13 04:37:51.025029 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 629/1281] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:50 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1275 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:52.040861 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f85c98e8-4151-4a6c-a67d-0b84f38df0f6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:52.041591 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f85c98e8-4151-4a6c-a67d-0b84f38df0f6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:52.047416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f85c98e8-4151-4a6c-a67d-0b84f38df0f6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:52.048692 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f85c98e8-4151-4a6c-a67d-0b84f38df0f6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:52.049189 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f85c98e8-4151-4a6c-a67d-0b84f38df0f6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:52.049654 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f85c98e8-4151-4a6c-a67d-0b84f38df0f6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:52.108246 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f85c98e8-4151-4a6c-a67d-0b84f38df0f6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:52.115393 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f85c98e8-4151-4a6c-a67d-0b84f38df0f6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1285 microversion: 2.1 time: 0.078248 Aug 13 04:37:52.115952 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 653/1282] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:52 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1285 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:53.132888 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2cf6c713-1131-4cfc-a03a-83935931b1c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:53.133574 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2cf6c713-1131-4cfc-a03a-83935931b1c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:53.139368 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2cf6c713-1131-4cfc-a03a-83935931b1c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:53.139811 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2cf6c713-1131-4cfc-a03a-83935931b1c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:53.140593 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2cf6c713-1131-4cfc-a03a-83935931b1c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:53.141006 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2cf6c713-1131-4cfc-a03a-83935931b1c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:53.203684 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2cf6c713-1131-4cfc-a03a-83935931b1c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:53.212352 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2cf6c713-1131-4cfc-a03a-83935931b1c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1273 microversion: 2.1 time: 0.083341 Aug 13 04:37:53.212917 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 630/1283] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:53 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:54.228964 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-188ec30c-7d56-434c-9a76-3291a532f4c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:54.230090 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-188ec30c-7d56-434c-9a76-3291a532f4c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:54.236942 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-188ec30c-7d56-434c-9a76-3291a532f4c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:54.237535 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-188ec30c-7d56-434c-9a76-3291a532f4c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:54.238474 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-188ec30c-7d56-434c-9a76-3291a532f4c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:54.238993 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-188ec30c-7d56-434c-9a76-3291a532f4c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:54.305392 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-3154b541-8e70-4b6b-a1ad-1f2743d34796 req-51dbe51c-056b-48c2-be85-9a2fe6a3f9db service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "953e9b27-2181-48ed-9465-4ef8f4d2cc3c", "tag": "cbb84333-8c76-46f4-a479-761ecbaca9e4"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:54.307077 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:37:54.307077 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:37:54.315062 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-3154b541-8e70-4b6b-a1ad-1f2743d34796 req-51dbe51c-056b-48c2-be85-9a2fe6a3f9db service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:54.315866 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-3154b541-8e70-4b6b-a1ad-1f2743d34796 req-51dbe51c-056b-48c2-be85-9a2fe6a3f9db service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:54.330983 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-3154b541-8e70-4b6b-a1ad-1f2743d34796 req-51dbe51c-056b-48c2-be85-9a2fe6a3f9db service nova] Creating event network-changed:cbb84333-8c76-46f4-a479-761ecbaca9e4 for instance 953e9b27-2181-48ed-9465-4ef8f4d2cc3c on hv-cinder-75996 Aug 13 04:37:54.335964 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-3154b541-8e70-4b6b-a1ad-1f2743d34796 req-51dbe51c-056b-48c2-be85-9a2fe6a3f9db service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034226 Aug 13 04:37:54.336897 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 631/1284] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:37:54 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:37:54.382614 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-188ec30c-7d56-434c-9a76-3291a532f4c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:54.390632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-188ec30c-7d56-434c-9a76-3291a532f4c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1315 microversion: 2.1 time: 0.165455 Aug 13 04:37:54.391668 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 654/1285] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:54 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:55.408484 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ef95bb32-b627-4713-9a88-f44eab7472c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:55.409086 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ef95bb32-b627-4713-9a88-f44eab7472c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:55.415122 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef95bb32-b627-4713-9a88-f44eab7472c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:55.415578 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef95bb32-b627-4713-9a88-f44eab7472c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:55.416342 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef95bb32-b627-4713-9a88-f44eab7472c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:55.416776 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ef95bb32-b627-4713-9a88-f44eab7472c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:55.535914 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ef95bb32-b627-4713-9a88-f44eab7472c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:55.543119 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ef95bb32-b627-4713-9a88-f44eab7472c0 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1315 microversion: 2.1 time: 0.139061 Aug 13 04:37:55.543679 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 632/1286] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:55 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1315 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:56.560145 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-531b95d2-3301-499e-9b4d-c36a23c9573f tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:56.560902 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-531b95d2-3301-499e-9b4d-c36a23c9573f tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:56.567245 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-531b95d2-3301-499e-9b4d-c36a23c9573f tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:56.567690 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-531b95d2-3301-499e-9b4d-c36a23c9573f tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:56.568456 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-531b95d2-3301-499e-9b4d-c36a23c9573f tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:56.568888 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-531b95d2-3301-499e-9b4d-c36a23c9573f tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:56.694374 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-531b95d2-3301-499e-9b4d-c36a23c9573f tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:56.701814 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-531b95d2-3301-499e-9b4d-c36a23c9573f tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1315 microversion: 2.1 time: 0.145592 Aug 13 04:37:56.702391 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 655/1287] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:56 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:57.717493 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-cec5e383-1aaa-466e-80b7-5bbdf03ea2c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:57.718102 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-cec5e383-1aaa-466e-80b7-5bbdf03ea2c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:57.724062 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cec5e383-1aaa-466e-80b7-5bbdf03ea2c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:57.724498 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cec5e383-1aaa-466e-80b7-5bbdf03ea2c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:57.725359 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cec5e383-1aaa-466e-80b7-5bbdf03ea2c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:57.725818 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cec5e383-1aaa-466e-80b7-5bbdf03ea2c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:57.843687 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-cec5e383-1aaa-466e-80b7-5bbdf03ea2c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:57.850939 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-cec5e383-1aaa-466e-80b7-5bbdf03ea2c6 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1315 microversion: 2.1 time: 0.137085 Aug 13 04:37:57.851496 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 633/1288] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:57 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1315 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:37:58.867471 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-791f4581-84f0-47ec-8f9b-9d9b58c25820 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:37:58.868101 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-791f4581-84f0-47ec-8f9b-9d9b58c25820 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:37:58.873836 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-791f4581-84f0-47ec-8f9b-9d9b58c25820 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:58.874305 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-791f4581-84f0-47ec-8f9b-9d9b58c25820 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:58.875059 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-791f4581-84f0-47ec-8f9b-9d9b58c25820 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:58.875578 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-791f4581-84f0-47ec-8f9b-9d9b58c25820 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:58.896974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-ab504a03-25c5-4ad3-8219-f23a6d0ef60d req-31875d07-5892-4e76-af80-ec87812ffcf5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953e9b27-2181-48ed-9465-4ef8f4d2cc3c", "name": "network-vif-plugged", "status": "completed", "tag": "cbb84333-8c76-46f4-a479-761ecbaca9e4"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:37:58.898800 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:37:58.898800 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:37:58.905868 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-ab504a03-25c5-4ad3-8219-f23a6d0ef60d req-31875d07-5892-4e76-af80-ec87812ffcf5 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:37:58.906471 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-ab504a03-25c5-4ad3-8219-f23a6d0ef60d req-31875d07-5892-4e76-af80-ec87812ffcf5 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:37:58.922355 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-ab504a03-25c5-4ad3-8219-f23a6d0ef60d req-31875d07-5892-4e76-af80-ec87812ffcf5 service nova] Creating event network-vif-plugged:cbb84333-8c76-46f4-a479-761ecbaca9e4 for instance 953e9b27-2181-48ed-9465-4ef8f4d2cc3c on hv-cinder-75996 Aug 13 04:37:58.927957 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-ab504a03-25c5-4ad3-8219-f23a6d0ef60d req-31875d07-5892-4e76-af80-ec87812ffcf5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035347 Aug 13 04:37:58.928767 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 634/1289] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:37:58 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:37:58.999379 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-791f4581-84f0-47ec-8f9b-9d9b58c25820 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:37:59.007142 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-791f4581-84f0-47ec-8f9b-9d9b58c25820 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1315 microversion: 2.1 time: 0.143419 Aug 13 04:37:59.007704 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 656/1290] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:37:58 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1315 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:00.023806 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3fba4722-fdab-4059-a1f8-2c18d82e6af8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:00.024538 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3fba4722-fdab-4059-a1f8-2c18d82e6af8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:00.030659 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3fba4722-fdab-4059-a1f8-2c18d82e6af8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:00.031106 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3fba4722-fdab-4059-a1f8-2c18d82e6af8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:00.032389 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3fba4722-fdab-4059-a1f8-2c18d82e6af8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:00.033291 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3fba4722-fdab-4059-a1f8-2c18d82e6af8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:00.161621 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3fba4722-fdab-4059-a1f8-2c18d82e6af8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:00.168867 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3fba4722-fdab-4059-a1f8-2c18d82e6af8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1315 microversion: 2.1 time: 0.149114 Aug 13 04:38:00.169458 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 635/1291] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:00 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:01.186445 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b797ac55-69e5-4c1d-88cc-135ca2b2a781 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:01.187005 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b797ac55-69e5-4c1d-88cc-135ca2b2a781 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:01.194209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b797ac55-69e5-4c1d-88cc-135ca2b2a781 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:01.194798 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b797ac55-69e5-4c1d-88cc-135ca2b2a781 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:01.195605 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b797ac55-69e5-4c1d-88cc-135ca2b2a781 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:01.196132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b797ac55-69e5-4c1d-88cc-135ca2b2a781 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:01.561735 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b797ac55-69e5-4c1d-88cc-135ca2b2a781 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:01.568861 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b797ac55-69e5-4c1d-88cc-135ca2b2a781 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1315 microversion: 2.1 time: 0.386415 Aug 13 04:38:01.569415 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 657/1292] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:01 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1315 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:02.585409 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2875b755-2a90-460e-af88-2fdfc673f4ac tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:02.586022 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2875b755-2a90-460e-af88-2fdfc673f4ac tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:02.591833 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2875b755-2a90-460e-af88-2fdfc673f4ac tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:02.592276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2875b755-2a90-460e-af88-2fdfc673f4ac tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:02.593027 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2875b755-2a90-460e-af88-2fdfc673f4ac tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:02.593482 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2875b755-2a90-460e-af88-2fdfc673f4ac tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:02.711563 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2875b755-2a90-460e-af88-2fdfc673f4ac tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:02.718812 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2875b755-2a90-460e-af88-2fdfc673f4ac tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1464 microversion: 2.1 time: 0.137266 Aug 13 04:38:02.719963 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 636/1293] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:02 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1464 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:02.755732 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-844eda98-0930-40a6-8342-1b9fe41dea19 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:02.756226 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-844eda98-0930-40a6-8342-1b9fe41dea19 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:02.761956 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-844eda98-0930-40a6-8342-1b9fe41dea19 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:02.762394 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-844eda98-0930-40a6-8342-1b9fe41dea19 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:02.763146 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-844eda98-0930-40a6-8342-1b9fe41dea19 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:02.763574 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-844eda98-0930-40a6-8342-1b9fe41dea19 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:02.788934 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-844eda98-0930-40a6-8342-1b9fe41dea19 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:38:02.861988 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-844eda98-0930-40a6-8342-1b9fe41dea19 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "DELETE /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 204 len: 0 microversion: 2.1 time: 0.109423 Aug 13 04:38:02.862571 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 658/1294] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:38:02 2021] DELETE /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Aug 13 04:38:02.872189 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-52915eec-376d-474c-9e19-7192507c5db8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:02.872919 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-52915eec-376d-474c-9e19-7192507c5db8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:02.879920 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-52915eec-376d-474c-9e19-7192507c5db8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:02.880366 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-52915eec-376d-474c-9e19-7192507c5db8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:02.881132 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-52915eec-376d-474c-9e19-7192507c5db8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:02.881591 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-52915eec-376d-474c-9e19-7192507c5db8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:03.004672 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-52915eec-376d-474c-9e19-7192507c5db8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:03.012101 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-52915eec-376d-474c-9e19-7192507c5db8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1470 microversion: 2.1 time: 0.143965 Aug 13 04:38:03.012681 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 637/1295] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:02 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1470 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:04.031113 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-58073b14-bd77-491b-bf93-1f5abf2728f8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:04.032416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-58073b14-bd77-491b-bf93-1f5abf2728f8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:04.038414 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58073b14-bd77-491b-bf93-1f5abf2728f8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:04.038876 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58073b14-bd77-491b-bf93-1f5abf2728f8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:04.039630 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58073b14-bd77-491b-bf93-1f5abf2728f8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:04.040070 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-58073b14-bd77-491b-bf93-1f5abf2728f8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:04.162650 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-58073b14-bd77-491b-bf93-1f5abf2728f8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:04.172085 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-58073b14-bd77-491b-bf93-1f5abf2728f8 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1470 microversion: 2.1 time: 0.144956 Aug 13 04:38:04.173155 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 659/1296] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:04 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1470 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:04.850684 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-9d210056-e952-4375-aac6-dcab720c2791 req-056ca88d-c677-4c87-891f-9df2ec6c9ce0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "953e9b27-2181-48ed-9465-4ef8f4d2cc3c", "name": "network-vif-deleted", "tag": "cbb84333-8c76-46f4-a479-761ecbaca9e4"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:38:04.852170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:38:04.852170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:38:04.859344 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-9d210056-e952-4375-aac6-dcab720c2791 req-056ca88d-c677-4c87-891f-9df2ec6c9ce0 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:04.860566 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-9d210056-e952-4375-aac6-dcab720c2791 req-056ca88d-c677-4c87-891f-9df2ec6c9ce0 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:04.872292 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-9d210056-e952-4375-aac6-dcab720c2791 req-056ca88d-c677-4c87-891f-9df2ec6c9ce0 service nova] Creating event network-vif-deleted:cbb84333-8c76-46f4-a479-761ecbaca9e4 for instance 953e9b27-2181-48ed-9465-4ef8f4d2cc3c on hv-cinder-75996 Aug 13 04:38:04.877789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-9d210056-e952-4375-aac6-dcab720c2791 req-056ca88d-c677-4c87-891f-9df2ec6c9ce0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030716 Aug 13 04:38:04.878603 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 638/1297] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:38:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:38:05.190289 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:05.190837 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:05.196693 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:05.197133 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:05.197914 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:05.198342 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:05.228131 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:05.228566 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:05.229008 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lazy-loading 'fault' on Instance uuid 953e9b27-2181-48ed-9465-4ef8f4d2cc3c {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:38:05.269313 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bfc60032f246408b8d8512b87977bd92', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '784971d178e449a7b8af2b8d2043b108', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:05.277345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c92f878e-210c-4bd5-b725-3579b3bf41ba tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 200 len: 1305 microversion: 2.1 time: 0.091364 Aug 13 04:38:05.278120 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 660/1298] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:05 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 1305 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:06.294904 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1d04a7da-929c-4f1d-be68-7ee38078e1e4 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:06.295533 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1d04a7da-929c-4f1d-be68-7ee38078e1e4 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] [instance: 953e9b27-2181-48ed-9465-4ef8f4d2cc3c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:06.302409 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d04a7da-929c-4f1d-be68-7ee38078e1e4 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:06.302860 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d04a7da-929c-4f1d-be68-7ee38078e1e4 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:06.303627 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d04a7da-929c-4f1d-be68-7ee38078e1e4 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:06.304062 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d04a7da-929c-4f1d-be68-7ee38078e1e4 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:06.317134 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-1d04a7da-929c-4f1d-be68-7ee38078e1e4 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] HTTP exception thrown: Instance 953e9b27-2181-48ed-9465-4ef8f4d2cc3c could not be found. Aug 13 04:38:06.317737 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1d04a7da-929c-4f1d-be68-7ee38078e1e4 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] Returning 404 to user: Instance 953e9b27-2181-48ed-9465-4ef8f4d2cc3c could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:38:06.318579 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1d04a7da-929c-4f1d-be68-7ee38078e1e4 tempest-VolumesNegativeTest-293982383 tempest-VolumesNegativeTest-293982383-project] 10.222.0.13 "GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c" status: 404 len: 111 microversion: 2.1 time: 0.027769 Aug 13 04:38:06.319091 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 639/1299] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:06 2021] GET /compute/v2.1/servers/953e9b27-2181-48ed-9465-4ef8f4d2cc3c => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:38:20.254593 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-be90b5e4-55a6-4e11-9a50-1116f9658b41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:20.255603 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-be90b5e4-55a6-4e11-9a50-1116f9658b41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:20.261567 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-be90b5e4-55a6-4e11-9a50-1116f9658b41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:20.262015 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-be90b5e4-55a6-4e11-9a50-1116f9658b41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:20.262775 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-be90b5e4-55a6-4e11-9a50-1116f9658b41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:20.263209 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-be90b5e4-55a6-4e11-9a50-1116f9658b41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:20.292724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-be90b5e4-55a6-4e11-9a50-1116f9658b41 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042023 Aug 13 04:38:20.293265 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 661/1300] 10.222.0.13 () {60 vars in 1343 bytes} [Fri Aug 13 04:38:20 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:20.351121 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-c233d06f-13a3-4afd-92ca-f8475eb660b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:20.351639 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c233d06f-13a3-4afd-92ca-f8475eb660b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:20.357280 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c233d06f-13a3-4afd-92ca-f8475eb660b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:20.357748 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c233d06f-13a3-4afd-92ca-f8475eb660b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:20.358494 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c233d06f-13a3-4afd-92ca-f8475eb660b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:20.358921 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-c233d06f-13a3-4afd-92ca-f8475eb660b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:20.384749 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-c233d06f-13a3-4afd-92ca-f8475eb660b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Going to try to terminate instance {{(pid=108288) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:38:20.457329 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-c233d06f-13a3-4afd-92ca-f8475eb660b8 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 204 len: 0 microversion: 2.20 time: 0.110038 Aug 13 04:38:20.457866 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 640/1301] 10.222.0.13 () {60 vars in 1280 bytes} [Fri Aug 13 04:38:20 2021] DELETE /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 13 04:38:20.466801 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ad4d0985-cf7a-4171-b7cb-bd8f9bac8bed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:20.467415 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ad4d0985-cf7a-4171-b7cb-bd8f9bac8bed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:20.473150 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ad4d0985-cf7a-4171-b7cb-bd8f9bac8bed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:20.473631 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ad4d0985-cf7a-4171-b7cb-bd8f9bac8bed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:20.475557 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ad4d0985-cf7a-4171-b7cb-bd8f9bac8bed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:20.475994 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ad4d0985-cf7a-4171-b7cb-bd8f9bac8bed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:20.599584 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ad4d0985-cf7a-4171-b7cb-bd8f9bac8bed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:20.607256 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ad4d0985-cf7a-4171-b7cb-bd8f9bac8bed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:20.608721 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-ad4d0985-cf7a-4171-b7cb-bd8f9bac8bed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:20.609865 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ad4d0985-cf7a-4171-b7cb-bd8f9bac8bed tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.146799 Aug 13 04:38:20.610412 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 662/1302] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:38:20 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:38:21.628432 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-5142fd7f-3f88-470a-b665-b18258a00def tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:21.629139 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-5142fd7f-3f88-470a-b665-b18258a00def tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:21.635068 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5142fd7f-3f88-470a-b665-b18258a00def tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:21.635521 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5142fd7f-3f88-470a-b665-b18258a00def tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:21.636286 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5142fd7f-3f88-470a-b665-b18258a00def tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:21.636724 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-5142fd7f-3f88-470a-b665-b18258a00def tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:21.756380 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5142fd7f-3f88-470a-b665-b18258a00def tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:21.764024 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5142fd7f-3f88-470a-b665-b18258a00def tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:21.765526 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-5142fd7f-3f88-470a-b665-b18258a00def tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:21.766640 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-5142fd7f-3f88-470a-b665-b18258a00def tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1720 microversion: 2.20 time: 0.142359 Aug 13 04:38:21.767194 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 641/1303] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:38:21 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1720 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:38:22.624857 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-39d14232-4c7f-4dc4-80f2-987399c33c6f req-5310ada4-077b-48c4-8c05-7c7153f2da57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15f3dbb4-dc66-4923-95f0-d53a986ebf82", "name": "network-vif-deleted", "tag": "25bafb0e-0d63-4fa6-a942-fc8e07163718"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:38:22.624857 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:38:22.624857 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:38:22.629416 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-39d14232-4c7f-4dc4-80f2-987399c33c6f req-5310ada4-077b-48c4-8c05-7c7153f2da57 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:22.630201 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-39d14232-4c7f-4dc4-80f2-987399c33c6f req-5310ada4-077b-48c4-8c05-7c7153f2da57 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:22.645040 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-39d14232-4c7f-4dc4-80f2-987399c33c6f req-5310ada4-077b-48c4-8c05-7c7153f2da57 service nova] Creating event network-vif-deleted:25bafb0e-0d63-4fa6-a942-fc8e07163718 for instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 on hv-cinder-75996 Aug 13 04:38:22.652161 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-39d14232-4c7f-4dc4-80f2-987399c33c6f req-5310ada4-077b-48c4-8c05-7c7153f2da57 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035632 Aug 13 04:38:22.652937 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 663/1304] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:38:22 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:38:22.784327 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:22.784935 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:22.792915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:22.793605 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:22.794400 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:22.794828 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:22.830350 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:22.831084 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:22.831545 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lazy-loading 'fault' on Instance uuid 15f3dbb4-dc66-4923-95f0-d53a986ebf82 {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:38:22.874383 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:22.888831 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:22.890348 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '79f213e02f8d44e789aae985fa15d58f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '97bcef962215442fa34d9ef949492fc4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:22.891468 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ccea76cd-bf0d-4bf3-9e51-b143366ed6c9 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 200 len: 1370 microversion: 2.20 time: 0.110895 Aug 13 04:38:22.892021 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 642/1305] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:38:22 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 1370 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Aug 13 04:38:23.910422 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0255f811-1f94-4dbd-aaea-187e867ef7bf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:23.911123 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-0255f811-1f94-4dbd-aaea-187e867ef7bf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:23.917241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0255f811-1f94-4dbd-aaea-187e867ef7bf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:23.917724 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0255f811-1f94-4dbd-aaea-187e867ef7bf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:23.918502 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0255f811-1f94-4dbd-aaea-187e867ef7bf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:23.918932 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-0255f811-1f94-4dbd-aaea-187e867ef7bf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:23.931480 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-0255f811-1f94-4dbd-aaea-187e867ef7bf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] HTTP exception thrown: Instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 could not be found. Aug 13 04:38:23.932055 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-0255f811-1f94-4dbd-aaea-187e867ef7bf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Returning 404 to user: Instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:38:23.932852 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-0255f811-1f94-4dbd-aaea-187e867ef7bf tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 404 len: 111 microversion: 2.20 time: 0.026495 Aug 13 04:38:23.933354 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 664/1306] 10.222.0.13 () {60 vars in 1277 bytes} [Fri Aug 13 04:38:23 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Aug 13 04:38:23.941616 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2fb51c8a-dc02-4800-8237-7810e70d4247 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '.version_select at 0x7fc46c494790>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:23.960020 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2fb51c8a-dc02-4800-8237-7810e70d4247 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-709286893" status: 204 len: 0 microversion: 2.20 time: 0.021937 Aug 13 04:38:23.960570 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 643/1307] 10.222.0.13 () {60 vars in 1259 bytes} [Fri Aug 13 04:38:23 2021] DELETE /compute/v2.1/os-keypairs/tempest-keypair-709286893 => generated 0 bytes in 23 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Aug 13 04:38:25.714311 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e931200b-7a2e-45c6-b20f-aaee9e5f3a8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:25.714797 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-e931200b-7a2e-45c6-b20f-aaee9e5f3a8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:25.720455 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e931200b-7a2e-45c6-b20f-aaee9e5f3a8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:25.720902 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e931200b-7a2e-45c6-b20f-aaee9e5f3a8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:25.721683 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e931200b-7a2e-45c6-b20f-aaee9e5f3a8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:25.722119 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-e931200b-7a2e-45c6-b20f-aaee9e5f3a8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:25.734941 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-e931200b-7a2e-45c6-b20f-aaee9e5f3a8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] HTTP exception thrown: Instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 could not be found. Aug 13 04:38:25.735511 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-e931200b-7a2e-45c6-b20f-aaee9e5f3a8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Returning 404 to user: Instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:38:25.736307 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-e931200b-7a2e-45c6-b20f-aaee9e5f3a8e tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 404 len: 111 microversion: 2.1 time: 0.025638 Aug 13 04:38:25.736807 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 665/1308] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:38:25 2021] DELETE /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:38:25.745070 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-38441589-495e-42cc-8a8f-005196ff0d7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:25.745712 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-38441589-495e-42cc-8a8f-005196ff0d7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: 15f3dbb4-dc66-4923-95f0-d53a986ebf82] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:25.751514 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-38441589-495e-42cc-8a8f-005196ff0d7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:25.751947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-38441589-495e-42cc-8a8f-005196ff0d7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:25.752696 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-38441589-495e-42cc-8a8f-005196ff0d7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:25.753131 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-38441589-495e-42cc-8a8f-005196ff0d7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:25.765896 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-38441589-495e-42cc-8a8f-005196ff0d7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] HTTP exception thrown: Instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 could not be found. Aug 13 04:38:25.766464 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-38441589-495e-42cc-8a8f-005196ff0d7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Returning 404 to user: Instance 15f3dbb4-dc66-4923-95f0-d53a986ebf82 could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:38:25.767264 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-38441589-495e-42cc-8a8f-005196ff0d7a tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82" status: 404 len: 111 microversion: 2.1 time: 0.026655 Aug 13 04:38:25.767762 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 644/1309] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:25 2021] GET /compute/v2.1/servers/15f3dbb4-dc66-4923-95f0-d53a986ebf82 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:38:26.898264 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1f0732e6-aef9-4c60-90fd-9e1d17d3b43c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:26.898754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1f0732e6-aef9-4c60-90fd-9e1d17d3b43c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:26.904565 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1f0732e6-aef9-4c60-90fd-9e1d17d3b43c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:26.905014 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1f0732e6-aef9-4c60-90fd-9e1d17d3b43c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:26.905818 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1f0732e6-aef9-4c60-90fd-9e1d17d3b43c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:26.906259 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1f0732e6-aef9-4c60-90fd-9e1d17d3b43c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:26.919126 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-1f0732e6-aef9-4c60-90fd-9e1d17d3b43c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] HTTP exception thrown: Instance d299e5c1-cd60-4057-93a3-5d32e1908d2f could not be found. Aug 13 04:38:26.919698 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1f0732e6-aef9-4c60-90fd-9e1d17d3b43c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Returning 404 to user: Instance d299e5c1-cd60-4057-93a3-5d32e1908d2f could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:38:26.920501 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1f0732e6-aef9-4c60-90fd-9e1d17d3b43c tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 404 len: 111 microversion: 2.1 time: 0.026700 Aug 13 04:38:26.921002 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 666/1310] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:38:26 2021] DELETE /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:38:26.929188 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d2b53237-004d-44b8-a366-69feef1d5d29 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:26.929855 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-d2b53237-004d-44b8-a366-69feef1d5d29 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] [instance: d299e5c1-cd60-4057-93a3-5d32e1908d2f] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:26.935813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d2b53237-004d-44b8-a366-69feef1d5d29 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:26.936256 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d2b53237-004d-44b8-a366-69feef1d5d29 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:26.937015 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d2b53237-004d-44b8-a366-69feef1d5d29 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:26.937461 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-d2b53237-004d-44b8-a366-69feef1d5d29 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:26.951078 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-d2b53237-004d-44b8-a366-69feef1d5d29 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] HTTP exception thrown: Instance d299e5c1-cd60-4057-93a3-5d32e1908d2f could not be found. Aug 13 04:38:26.951656 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-d2b53237-004d-44b8-a366-69feef1d5d29 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] Returning 404 to user: Instance d299e5c1-cd60-4057-93a3-5d32e1908d2f could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:38:26.952457 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-d2b53237-004d-44b8-a366-69feef1d5d29 tempest-AttachVolumeShelveTestJSON-2071694818 tempest-AttachVolumeShelveTestJSON-2071694818-project] 10.222.0.13 "GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f" status: 404 len: 111 microversion: 2.1 time: 0.027402 Aug 13 04:38:26.952957 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 645/1311] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:26 2021] GET /compute/v2.1/servers/d299e5c1-cd60-4057-93a3-5d32e1908d2f => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:38:34.527754 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-2131f06d-e78f-449b-b8fd-ff9e5444ff08 req-abe04f5a-35f0-45d9-8430-0ae2d71ea9d4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ba719a9-61df-4d8d-99c1-907f97a80e8e", "tag": "1166ab58-4fa6-49a1-b301-c03b411d9dc0"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:38:34.529358 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:38:34.529358 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:38:34.530910 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b71f773e-fdd2-4a21-b858-1d25c3bc822b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:34.531500 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b71f773e-fdd2-4a21-b858-1d25c3bc822b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:34.537051 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-2131f06d-e78f-449b-b8fd-ff9e5444ff08 req-abe04f5a-35f0-45d9-8430-0ae2d71ea9d4 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:34.537789 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-2131f06d-e78f-449b-b8fd-ff9e5444ff08 req-abe04f5a-35f0-45d9-8430-0ae2d71ea9d4 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:34.537922 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b71f773e-fdd2-4a21-b858-1d25c3bc822b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:34.538411 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b71f773e-fdd2-4a21-b858-1d25c3bc822b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:34.539363 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b71f773e-fdd2-4a21-b858-1d25c3bc822b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:34.539872 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b71f773e-fdd2-4a21-b858-1d25c3bc822b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:34.549803 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-2131f06d-e78f-449b-b8fd-ff9e5444ff08 req-abe04f5a-35f0-45d9-8430-0ae2d71ea9d4 service nova] Creating event network-changed:1166ab58-4fa6-49a1-b301-c03b411d9dc0 for instance 5ba719a9-61df-4d8d-99c1-907f97a80e8e on hv-cinder-75996 Aug 13 04:38:34.555231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-2131f06d-e78f-449b-b8fd-ff9e5444ff08 req-abe04f5a-35f0-45d9-8430-0ae2d71ea9d4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030988 Aug 13 04:38:34.555903 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 646/1312] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:38:34 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:38:34.567334 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b71f773e-fdd2-4a21-b858-1d25c3bc822b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Going to try to terminate instance {{(pid=108287) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:38:34.651515 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b71f773e-fdd2-4a21-b858-1d25c3bc822b tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 204 len: 0 microversion: 2.1 time: 0.130394 Aug 13 04:38:34.652417 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 667/1313] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:38:34 2021] DELETE /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:38:34.665551 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-e797fbe2-7f44-49f1-a5e7-32fefb5f9045 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:34.666451 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-e797fbe2-7f44-49f1-a5e7-32fefb5f9045 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:34.673467 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e797fbe2-7f44-49f1-a5e7-32fefb5f9045 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:34.674112 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e797fbe2-7f44-49f1-a5e7-32fefb5f9045 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:34.675053 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e797fbe2-7f44-49f1-a5e7-32fefb5f9045 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:34.675593 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-e797fbe2-7f44-49f1-a5e7-32fefb5f9045 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:34.809883 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-e797fbe2-7f44-49f1-a5e7-32fefb5f9045 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:34.818305 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-e797fbe2-7f44-49f1-a5e7-32fefb5f9045 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1568 microversion: 2.1 time: 0.158929 Aug 13 04:38:34.819138 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 647/1314] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:34 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1568 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:38:35.837008 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-9b29333c-fc31-446c-8996-5f78298140a9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:35.837756 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-9b29333c-fc31-446c-8996-5f78298140a9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:35.843672 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9b29333c-fc31-446c-8996-5f78298140a9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:35.844118 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9b29333c-fc31-446c-8996-5f78298140a9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:35.844938 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9b29333c-fc31-446c-8996-5f78298140a9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:35.845366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-9b29333c-fc31-446c-8996-5f78298140a9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:35.972481 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-9b29333c-fc31-446c-8996-5f78298140a9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:35.980080 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-9b29333c-fc31-446c-8996-5f78298140a9 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1449 microversion: 2.1 time: 0.147832 Aug 13 04:38:35.980646 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 668/1315] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:35 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1449 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:36.643387 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-c2b894e9-b96e-4a8f-8934-c9c80196c307 req-771631b8-a3a9-42ef-8fff-acf618f069b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ba719a9-61df-4d8d-99c1-907f97a80e8e", "name": "network-vif-deleted", "tag": "1166ab58-4fa6-49a1-b301-c03b411d9dc0"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:38:36.645049 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:38:36.645049 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:38:36.652386 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-c2b894e9-b96e-4a8f-8934-c9c80196c307 req-771631b8-a3a9-42ef-8fff-acf618f069b5 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:36.652833 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-c2b894e9-b96e-4a8f-8934-c9c80196c307 req-771631b8-a3a9-42ef-8fff-acf618f069b5 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:36.664379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-c2b894e9-b96e-4a8f-8934-c9c80196c307 req-771631b8-a3a9-42ef-8fff-acf618f069b5 service nova] Creating event network-vif-deleted:1166ab58-4fa6-49a1-b301-c03b411d9dc0 for instance 5ba719a9-61df-4d8d-99c1-907f97a80e8e on hv-cinder-75996 Aug 13 04:38:36.668974 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-c2b894e9-b96e-4a8f-8934-c9c80196c307 req-771631b8-a3a9-42ef-8fff-acf618f069b5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029813 Aug 13 04:38:36.669578 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 648/1316] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:38:36 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:38:36.997192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:36.997837 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:37.004233 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:37.004958 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:37.006051 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:37.006552 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:37.041585 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:37.042370 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:37.042834 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.objects.instance [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lazy-loading 'fault' on Instance uuid 5ba719a9-61df-4d8d-99c1-907f97a80e8e {{(pid=108287) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:38:37.084282 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '44a59c76c3f141ea83419c098aef1aac', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '88885460859447cea3664074daf50abb', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:37.093977 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-675ab2fe-f9f1-41c6-872e-b49bc5522608 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 200 len: 1225 microversion: 2.1 time: 0.100847 Aug 13 04:38:37.097612 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 669/1317] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:36 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 1225 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:38.112276 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-34a2b399-a1b1-451d-8ed5-d9f16d318a5e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:38.112981 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-34a2b399-a1b1-451d-8ed5-d9f16d318a5e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] [instance: 5ba719a9-61df-4d8d-99c1-907f97a80e8e] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:38.119926 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34a2b399-a1b1-451d-8ed5-d9f16d318a5e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:38.120379 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34a2b399-a1b1-451d-8ed5-d9f16d318a5e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:38.121146 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34a2b399-a1b1-451d-8ed5-d9f16d318a5e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:38.121633 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-34a2b399-a1b1-451d-8ed5-d9f16d318a5e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:38.134710 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-34a2b399-a1b1-451d-8ed5-d9f16d318a5e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] HTTP exception thrown: Instance 5ba719a9-61df-4d8d-99c1-907f97a80e8e could not be found. Aug 13 04:38:38.135300 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-34a2b399-a1b1-451d-8ed5-d9f16d318a5e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Returning 404 to user: Instance 5ba719a9-61df-4d8d-99c1-907f97a80e8e could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:38:38.136123 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-34a2b399-a1b1-451d-8ed5-d9f16d318a5e tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e" status: 404 len: 111 microversion: 2.1 time: 0.027909 Aug 13 04:38:38.136667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 649/1318] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:38 2021] GET /compute/v2.1/servers/5ba719a9-61df-4d8d-99c1-907f97a80e8e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:38:38.305621 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d6db5e9c-a272-476e-bf40-b39aedd62096 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] Calling method '.version_select at 0x7fc45ffeb820>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:38.325468 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d6db5e9c-a272-476e-bf40-b39aedd62096 tempest-TestShelveInstance-267951449 tempest-TestShelveInstance-267951449-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1012993253" status: 202 len: 0 microversion: 2.1 time: 0.024666 Aug 13 04:38:38.326423 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 670/1319] 10.222.0.13 () {58 vars in 1254 bytes} [Fri Aug 13 04:38:38 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1012993253 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:38:49.568392 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1430904781", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1602395338", "security_groups": [{"name": "tempest-secgroup-smoke-2048961314"}], "block_device_mapping_v2": [{"uuid": "39d8d32c-c632-46b7-8cbf-8f1063204d12", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "87d3a17b-ea4d-435b-9c8e-36b4c38780d2"}]}} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:38:49.577005 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a5067ec1-b354-4295-a10e-39c9dbea15e4] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 13 04:38:49.678968 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.network.neutron [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] validate_networks() for [('87d3a17b-ea4d-435b-9c8e-36b4c38780d2', None, None, None)] {{(pid=108288) validate_networks /opt/stack/nova/nova/network/neutron.py:2255}} Aug 13 04:38:50.324360 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Flavor limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Aug 13 04:38:50.324803 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Image limits 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Aug 13 04:38:50.325270 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Flavor pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Aug 13 04:38:50.325691 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Image pref 0:0:0 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Aug 13 04:38:50.326121 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.virt.hardware [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=108288) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Aug 13 04:38:50.334720 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:50.335755 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "00000000-0000-0000-0000-000000000000" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:50.336565 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:50.337009 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:50.353850 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Getting quotas for project 6f2d284955ea4d12b60ceba4f7a53e87. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:384}} Aug 13 04:38:50.357801 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.quota [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Getting quotas for user 3abce7098260457cad30873156a242d0 and project 6f2d284955ea4d12b60ceba4f7a53e87. Resources: {'cores', 'instances', 'ram'} {{(pid=108288) _get_quotas /opt/stack/nova/nova/quota.py:374}} Aug 13 04:38:50.418605 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Going to run 1 instances... {{(pid=108288) _provision_instances /opt/stack/nova/nova/compute/api.py:1280}} Aug 13 04:38:50.420709 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='39d8d32c-c632-46b7-8cbf-8f1063204d12',volume_size=None,volume_type=None)] {{(pid=108288) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1685}} Aug 13 04:38:50.544909 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-22ff00d5-00aa-4c95-9f0f-074e4cffc674 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.980040 Aug 13 04:38:50.545947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 650/1320] 10.222.0.13 () {60 vars in 1147 bytes} [Fri Aug 13 04:38:49 2021] POST /compute/v2.1/servers => generated 406 bytes in 982 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Aug 13 04:38:50.556307 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f422d98b-26ea-43a8-a0b6-b204ecf5db39 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:50.556924 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f422d98b-26ea-43a8-a0b6-b204ecf5db39 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:50.622101 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f422d98b-26ea-43a8-a0b6-b204ecf5db39 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:50.629765 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f422d98b-26ea-43a8-a0b6-b204ecf5db39 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1095 microversion: 2.1 time: 0.077402 Aug 13 04:38:50.630337 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 671/1321] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:50 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1095 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Aug 13 04:38:51.647074 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-2c413200-97cd-468c-a2fb-ca617b0347d9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:51.649118 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-2c413200-97cd-468c-a2fb-ca617b0347d9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:51.673231 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO oslo.messaging._drivers.impl_rabbit [-] [a5067ec1-b354-4295-a10e-39c9dbea15e4] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53132. Aug 13 04:38:51.675779 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c413200-97cd-468c-a2fb-ca617b0347d9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:51.676222 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c413200-97cd-468c-a2fb-ca617b0347d9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:51.677059 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c413200-97cd-468c-a2fb-ca617b0347d9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:51.677455 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-2c413200-97cd-468c-a2fb-ca617b0347d9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:51.744913 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-2c413200-97cd-468c-a2fb-ca617b0347d9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:51.754098 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-2c413200-97cd-468c-a2fb-ca617b0347d9 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1211 microversion: 2.1 time: 0.110628 Aug 13 04:38:51.754755 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 651/1322] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:51 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1211 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:52.772017 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-1ff81716-13a7-4481-8185-a5ae233f8111 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:52.773260 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-1ff81716-13a7-4481-8185-a5ae233f8111 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:52.780365 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1ff81716-13a7-4481-8185-a5ae233f8111 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:52.781144 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1ff81716-13a7-4481-8185-a5ae233f8111 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:52.782132 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1ff81716-13a7-4481-8185-a5ae233f8111 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:52.782722 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-1ff81716-13a7-4481-8185-a5ae233f8111 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:52.833472 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [req-6d6cb8d5-7628-4ef3-b55d-d9ff9e9a9977 req-c1c34664-18bf-4378-86bc-a1397630d089 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016c7aa0-86aa-4e90-a0a8-8891c5060853", "tag": "6854a29b-61a3-4551-8e1d-898a3bb72326"}]} {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:38:52.845837 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:38:52.845837 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: warnings.warn(msg) Aug 13 04:38:52.856106 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-6d6cb8d5-7628-4ef3-b55d-d9ff9e9a9977 req-c1c34664-18bf-4378-86bc-a1397630d089 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:52.858284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [req-6d6cb8d5-7628-4ef3-b55d-d9ff9e9a9977 req-c1c34664-18bf-4378-86bc-a1397630d089 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:52.871212 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.compute.server_external_events [req-6d6cb8d5-7628-4ef3-b55d-d9ff9e9a9977 req-c1c34664-18bf-4378-86bc-a1397630d089 service nova] Creating event network-changed:6854a29b-61a3-4551-8e1d-898a3bb72326 for instance 016c7aa0-86aa-4e90-a0a8-8891c5060853 on hv-cinder-75996 Aug 13 04:38:52.876178 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [req-6d6cb8d5-7628-4ef3-b55d-d9ff9e9a9977 req-c1c34664-18bf-4378-86bc-a1397630d089 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053431 Aug 13 04:38:52.879972 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 652/1323] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:38:52 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:38:52.932378 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-1ff81716-13a7-4481-8185-a5ae233f8111 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:52.939901 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-1ff81716-13a7-4481-8185-a5ae233f8111 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.172008 Aug 13 04:38:52.940470 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 672/1324] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:52 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:53.957459 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-1d4ca33a-ee63-4c57-99ce-0d8baa6474c5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:53.958949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-1d4ca33a-ee63-4c57-99ce-0d8baa6474c5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:53.966242 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d4ca33a-ee63-4c57-99ce-0d8baa6474c5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:53.966945 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d4ca33a-ee63-4c57-99ce-0d8baa6474c5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:53.967915 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d4ca33a-ee63-4c57-99ce-0d8baa6474c5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:53.968706 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-1d4ca33a-ee63-4c57-99ce-0d8baa6474c5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:54.097718 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-1d4ca33a-ee63-4c57-99ce-0d8baa6474c5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:54.105163 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-1d4ca33a-ee63-4c57-99ce-0d8baa6474c5 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.151807 Aug 13 04:38:54.105760 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 653/1325] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:53 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:55.121655 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-69c897b9-ed88-485c-8f12-455720396f11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:55.122415 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-69c897b9-ed88-485c-8f12-455720396f11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:55.127963 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-69c897b9-ed88-485c-8f12-455720396f11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:55.128411 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-69c897b9-ed88-485c-8f12-455720396f11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:55.129165 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-69c897b9-ed88-485c-8f12-455720396f11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:55.129627 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-69c897b9-ed88-485c-8f12-455720396f11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:55.249947 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-69c897b9-ed88-485c-8f12-455720396f11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:55.257280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-69c897b9-ed88-485c-8f12-455720396f11 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.139236 Aug 13 04:38:55.258366 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 673/1326] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:55 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:56.275384 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ceec52f2-0ed2-425c-8438-fabb4c047962 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:56.276023 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ceec52f2-0ed2-425c-8438-fabb4c047962 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:56.282572 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ceec52f2-0ed2-425c-8438-fabb4c047962 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:56.283029 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ceec52f2-0ed2-425c-8438-fabb4c047962 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:56.283800 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ceec52f2-0ed2-425c-8438-fabb4c047962 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:56.284240 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ceec52f2-0ed2-425c-8438-fabb4c047962 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:56.403984 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ceec52f2-0ed2-425c-8438-fabb4c047962 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:56.411177 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ceec52f2-0ed2-425c-8438-fabb4c047962 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.140657 Aug 13 04:38:56.411737 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 654/1327] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:56 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:57.427253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-f94b4ccc-8c77-4cc3-8c99-ee605e8cbe95 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:57.427875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-f94b4ccc-8c77-4cc3-8c99-ee605e8cbe95 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:57.434620 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f94b4ccc-8c77-4cc3-8c99-ee605e8cbe95 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:57.435077 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f94b4ccc-8c77-4cc3-8c99-ee605e8cbe95 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:57.435849 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f94b4ccc-8c77-4cc3-8c99-ee605e8cbe95 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:57.436288 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-f94b4ccc-8c77-4cc3-8c99-ee605e8cbe95 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:57.567285 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-f94b4ccc-8c77-4cc3-8c99-ee605e8cbe95 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:57.575368 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-f94b4ccc-8c77-4cc3-8c99-ee605e8cbe95 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.151720 Aug 13 04:38:57.576329 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 674/1328] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:57 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:58.592775 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-74123a44-6f84-4865-92d4-9e108a44f2c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:58.593384 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-74123a44-6f84-4865-92d4-9e108a44f2c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:58.599208 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-74123a44-6f84-4865-92d4-9e108a44f2c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:58.599652 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-74123a44-6f84-4865-92d4-9e108a44f2c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:58.600401 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-74123a44-6f84-4865-92d4-9e108a44f2c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:58.600831 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-74123a44-6f84-4865-92d4-9e108a44f2c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:58.731955 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-74123a44-6f84-4865-92d4-9e108a44f2c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:58.739310 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-74123a44-6f84-4865-92d4-9e108a44f2c0 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.150253 Aug 13 04:38:58.739877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 655/1329] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:58 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:38:59.755875 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-b57b2a21-8d35-4933-b7b3-1334db4aa04a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:38:59.756529 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-b57b2a21-8d35-4933-b7b3-1334db4aa04a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:38:59.762591 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b57b2a21-8d35-4933-b7b3-1334db4aa04a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:59.763054 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b57b2a21-8d35-4933-b7b3-1334db4aa04a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:59.763831 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b57b2a21-8d35-4933-b7b3-1334db4aa04a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:38:59.764272 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-b57b2a21-8d35-4933-b7b3-1334db4aa04a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:38:59.941739 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-b57b2a21-8d35-4933-b7b3-1334db4aa04a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:38:59.950125 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-b57b2a21-8d35-4933-b7b3-1334db4aa04a tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.197941 Aug 13 04:38:59.950901 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 675/1330] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:38:59 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:39:00.967622 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3fcd8781-66d3-4e5f-a0c4-2f9d236493f3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:39:00.968242 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-3fcd8781-66d3-4e5f-a0c4-2f9d236493f3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:39:00.974332 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3fcd8781-66d3-4e5f-a0c4-2f9d236493f3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:00.974786 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3fcd8781-66d3-4e5f-a0c4-2f9d236493f3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:00.975556 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3fcd8781-66d3-4e5f-a0c4-2f9d236493f3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:00.975999 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-3fcd8781-66d3-4e5f-a0c4-2f9d236493f3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:01.103664 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-3fcd8781-66d3-4e5f-a0c4-2f9d236493f3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:39:01.111134 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3fcd8781-66d3-4e5f-a0c4-2f9d236493f3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.147098 Aug 13 04:39:01.111729 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 656/1331] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:39:00 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:39:02.128244 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-d40c54d4-2df3-4a4d-be18-5e6be081853c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:39:02.128983 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-d40c54d4-2df3-4a4d-be18-5e6be081853c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:39:02.135276 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d40c54d4-2df3-4a4d-be18-5e6be081853c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:02.136435 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d40c54d4-2df3-4a4d-be18-5e6be081853c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:02.141623 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d40c54d4-2df3-4a4d-be18-5e6be081853c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:02.142070 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-d40c54d4-2df3-4a4d-be18-5e6be081853c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:02.277091 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-d40c54d4-2df3-4a4d-be18-5e6be081853c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:39:02.284646 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-d40c54d4-2df3-4a4d-be18-5e6be081853c tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.160367 Aug 13 04:39:02.285210 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 676/1332] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:39:02 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:39:03.301628 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-526419c1-df85-48bd-a42e-400b6c10c4b6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:39:03.302309 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-526419c1-df85-48bd-a42e-400b6c10c4b6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:39:03.309132 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-526419c1-df85-48bd-a42e-400b6c10c4b6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:03.309889 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-526419c1-df85-48bd-a42e-400b6c10c4b6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:03.310667 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-526419c1-df85-48bd-a42e-400b6c10c4b6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:03.311104 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-526419c1-df85-48bd-a42e-400b6c10c4b6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:03.434140 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-526419c1-df85-48bd-a42e-400b6c10c4b6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:39:03.441572 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-526419c1-df85-48bd-a42e-400b6c10c4b6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.144226 Aug 13 04:39:03.442147 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 657/1333] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:39:03 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:39:04.159407 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-8cd99abc-659e-4e2f-8651-cf02d6a9009a req-cb7336b9-8321-4ad4-8838-10ce670b5cc3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016c7aa0-86aa-4e90-a0a8-8891c5060853", "name": "network-vif-plugged", "status": "completed", "tag": "6854a29b-61a3-4551-8e1d-898a3bb72326"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:39:04.161502 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:39:04.161502 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:39:04.169158 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-8cd99abc-659e-4e2f-8651-cf02d6a9009a req-cb7336b9-8321-4ad4-8838-10ce670b5cc3 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:04.169698 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-8cd99abc-659e-4e2f-8651-cf02d6a9009a req-cb7336b9-8321-4ad4-8838-10ce670b5cc3 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:04.180834 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-8cd99abc-659e-4e2f-8651-cf02d6a9009a req-cb7336b9-8321-4ad4-8838-10ce670b5cc3 service nova] Creating event network-vif-plugged:6854a29b-61a3-4551-8e1d-898a3bb72326 for instance 016c7aa0-86aa-4e90-a0a8-8891c5060853 on hv-cinder-75996 Aug 13 04:39:04.185914 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-8cd99abc-659e-4e2f-8651-cf02d6a9009a req-cb7336b9-8321-4ad4-8838-10ce670b5cc3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030175 Aug 13 04:39:04.186522 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 677/1334] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:39:04 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:39:04.459028 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-cca15544-dec5-4866-8706-ad53ad529a1e tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:39:04.459635 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-cca15544-dec5-4866-8706-ad53ad529a1e tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:39:04.465966 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cca15544-dec5-4866-8706-ad53ad529a1e tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:04.466406 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cca15544-dec5-4866-8706-ad53ad529a1e tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:04.467154 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cca15544-dec5-4866-8706-ad53ad529a1e tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:04.467579 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-cca15544-dec5-4866-8706-ad53ad529a1e tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:04.584725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-cca15544-dec5-4866-8706-ad53ad529a1e tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:39:04.592840 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-cca15544-dec5-4866-8706-ad53ad529a1e tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1267 microversion: 2.1 time: 0.137756 Aug 13 04:39:04.593418 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 658/1335] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:39:04 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1267 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:39:05.609799 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-516aa58d-9bb9-4856-bf5c-6cc402bdd25d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:39:05.610499 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-516aa58d-9bb9-4856-bf5c-6cc402bdd25d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:39:05.616565 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-516aa58d-9bb9-4856-bf5c-6cc402bdd25d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:05.617044 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-516aa58d-9bb9-4856-bf5c-6cc402bdd25d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:05.617812 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-516aa58d-9bb9-4856-bf5c-6cc402bdd25d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:05.618252 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-516aa58d-9bb9-4856-bf5c-6cc402bdd25d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:05.737290 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-516aa58d-9bb9-4856-bf5c-6cc402bdd25d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:39:05.744602 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-516aa58d-9bb9-4856-bf5c-6cc402bdd25d tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1454 microversion: 2.1 time: 0.138819 Aug 13 04:39:05.745170 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 678/1336] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:39:05 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1454 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:39:05.760522 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-ac9e5645-8d94-4ab1-b76e-8525ff1786d7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:39:05.761170 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-ac9e5645-8d94-4ab1-b76e-8525ff1786d7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:39:05.767083 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ac9e5645-8d94-4ab1-b76e-8525ff1786d7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:05.767534 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ac9e5645-8d94-4ab1-b76e-8525ff1786d7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:05.768301 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ac9e5645-8d94-4ab1-b76e-8525ff1786d7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:05.768761 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-ac9e5645-8d94-4ab1-b76e-8525ff1786d7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:05.891202 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-ac9e5645-8d94-4ab1-b76e-8525ff1786d7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:39:05.899358 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-ac9e5645-8d94-4ab1-b76e-8525ff1786d7 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1454 microversion: 2.1 time: 0.142440 Aug 13 04:39:05.899922 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 659/1337] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:39:05 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1454 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:39:07.773242 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-ae527639-09fd-4da8-8b09-842a389fb1ec req-6352ce5c-4a08-48b8-8865-dfb056948d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016c7aa0-86aa-4e90-a0a8-8891c5060853", "tag": "6854a29b-61a3-4551-8e1d-898a3bb72326"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:39:07.774770 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:39:07.774770 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:39:07.781902 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-ae527639-09fd-4da8-8b09-842a389fb1ec req-6352ce5c-4a08-48b8-8865-dfb056948d45 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:39:07.782349 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-ae527639-09fd-4da8-8b09-842a389fb1ec req-6352ce5c-4a08-48b8-8865-dfb056948d45 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:39:07.792818 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-ae527639-09fd-4da8-8b09-842a389fb1ec req-6352ce5c-4a08-48b8-8865-dfb056948d45 service nova] Creating event network-changed:6854a29b-61a3-4551-8e1d-898a3bb72326 for instance 016c7aa0-86aa-4e90-a0a8-8891c5060853 on hv-cinder-75996 Aug 13 04:39:07.797892 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-ae527639-09fd-4da8-8b09-842a389fb1ec req-6352ce5c-4a08-48b8-8865-dfb056948d45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028372 Aug 13 04:39:07.798660 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 679/1338] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:39:07 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:39:50.891272 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 13 04:39:50.891940 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: Fri Aug 13 04:39:50 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 13 04:40:37.842128 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-85bc8e88-03e3-4d23-93e0-8e56f23de169 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:37.845580 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: ERROR oslo.messaging._drivers.impl_rabbit [-] [e196d307-6e17-470d-85ac-d0818b730428] AMQP server on 10.222.0.13:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Aug 13 04:40:37.849632 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-5011f2d8-876c-4a36-bdc6-d89f3d2a721a req-9d7f1b7b-2ba7-4abf-8334-fb9c3678e67c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "016c7aa0-86aa-4e90-a0a8-8891c5060853", "tag": "6854a29b-61a3-4551-8e1d-898a3bb72326"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:40:37.849877 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-85bc8e88-03e3-4d23-93e0-8e56f23de169 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:37.852806 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:40:37.852806 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:40:37.857000 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-85bc8e88-03e3-4d23-93e0-8e56f23de169 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:37.857555 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-85bc8e88-03e3-4d23-93e0-8e56f23de169 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:37.858405 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-85bc8e88-03e3-4d23-93e0-8e56f23de169 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:37.859167 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-85bc8e88-03e3-4d23-93e0-8e56f23de169 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:37.860156 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-5011f2d8-876c-4a36-bdc6-d89f3d2a721a req-9d7f1b7b-2ba7-4abf-8334-fb9c3678e67c service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:37.860608 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-5011f2d8-876c-4a36-bdc6-d89f3d2a721a req-9d7f1b7b-2ba7-4abf-8334-fb9c3678e67c service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:37.873296 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-5011f2d8-876c-4a36-bdc6-d89f3d2a721a req-9d7f1b7b-2ba7-4abf-8334-fb9c3678e67c service nova] Creating event network-changed:6854a29b-61a3-4551-8e1d-898a3bb72326 for instance 016c7aa0-86aa-4e90-a0a8-8891c5060853 on hv-cinder-75996 Aug 13 04:40:37.878356 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-5011f2d8-876c-4a36-bdc6-d89f3d2a721a req-9d7f1b7b-2ba7-4abf-8334-fb9c3678e67c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034325 Aug 13 04:40:37.879150 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 680/1339] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:40:37 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:40:37.887321 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-85bc8e88-03e3-4d23-93e0-8e56f23de169 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Going to try to terminate instance {{(pid=108288) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:40:37.984624 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-85bc8e88-03e3-4d23-93e0-8e56f23de169 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "DELETE /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 204 len: 0 microversion: 2.1 time: 0.146204 Aug 13 04:40:37.984624 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 660/1340] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:40:37 2021] DELETE /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:40:37.993578 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c06eca27-d294-4d7f-9c0d-3e32aaf50996 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:37.994307 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c06eca27-d294-4d7f-9c0d-3e32aaf50996 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:38.000425 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c06eca27-d294-4d7f-9c0d-3e32aaf50996 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:38.000870 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c06eca27-d294-4d7f-9c0d-3e32aaf50996 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:38.001668 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c06eca27-d294-4d7f-9c0d-3e32aaf50996 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:38.002102 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c06eca27-d294-4d7f-9c0d-3e32aaf50996 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:38.307740 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c06eca27-d294-4d7f-9c0d-3e32aaf50996 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:40:38.315871 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c06eca27-d294-4d7f-9c0d-3e32aaf50996 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1578 microversion: 2.1 time: 0.326379 Aug 13 04:40:38.316574 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 681/1341] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:40:37 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1578 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:40:39.334243 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-f57a75a5-6d93-4b9c-ba38-e11c1be5c8da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:39.334941 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-f57a75a5-6d93-4b9c-ba38-e11c1be5c8da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:39.341723 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f57a75a5-6d93-4b9c-ba38-e11c1be5c8da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:39.342175 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f57a75a5-6d93-4b9c-ba38-e11c1be5c8da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:39.342949 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f57a75a5-6d93-4b9c-ba38-e11c1be5c8da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:39.343389 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-f57a75a5-6d93-4b9c-ba38-e11c1be5c8da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:39.518460 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-f57a75a5-6d93-4b9c-ba38-e11c1be5c8da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:40:39.525717 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-f57a75a5-6d93-4b9c-ba38-e11c1be5c8da tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1460 microversion: 2.1 time: 0.195511 Aug 13 04:40:39.526284 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 661/1342] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:40:39 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1460 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:40:40.012826 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-ce81ae7f-9693-48f3-a166-dbdea2f6ac96 req-d8770be1-0d10-4473-9265-2797e276a937 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "016c7aa0-86aa-4e90-a0a8-8891c5060853", "name": "network-vif-deleted", "tag": "6854a29b-61a3-4551-8e1d-898a3bb72326"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:40:40.014754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:40:40.014754 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:40:40.039433 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO oslo.messaging._drivers.impl_rabbit [-] [e196d307-6e17-470d-85ac-d0818b730428] Reconnected to AMQP server on 10.222.0.13:5672 via [amqp] client with port 53484. Aug 13 04:40:40.042144 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-ce81ae7f-9693-48f3-a166-dbdea2f6ac96 req-d8770be1-0d10-4473-9265-2797e276a937 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:40.042591 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-ce81ae7f-9693-48f3-a166-dbdea2f6ac96 req-d8770be1-0d10-4473-9265-2797e276a937 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:40.053987 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-ce81ae7f-9693-48f3-a166-dbdea2f6ac96 req-d8770be1-0d10-4473-9265-2797e276a937 service nova] Creating event network-vif-deleted:6854a29b-61a3-4551-8e1d-898a3bb72326 for instance 016c7aa0-86aa-4e90-a0a8-8891c5060853 on hv-cinder-75996 Aug 13 04:40:40.060056 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-ce81ae7f-9693-48f3-a166-dbdea2f6ac96 req-d8770be1-0d10-4473-9265-2797e276a937 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051480 Aug 13 04:40:40.060829 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 682/1343] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:40:40 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:40:40.543947 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:40.544469 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:40.550285 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:40.550725 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:40.551475 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:40.551899 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:40.582357 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:40.582802 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:40.583240 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lazy-loading 'fault' on Instance uuid 016c7aa0-86aa-4e90-a0a8-8891c5060853 {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:40:40.623813 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:40:40.631254 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-41278797-b362-4d93-b714-bfb9772292cd tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 200 len: 1231 microversion: 2.1 time: 0.091670 Aug 13 04:40:40.631816 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 662/1344] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:40:40 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:40:41.649518 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-79dd4d1b-f19b-481e-afcc-90565732bda6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:41.650253 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-79dd4d1b-f19b-481e-afcc-90565732bda6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 016c7aa0-86aa-4e90-a0a8-8891c5060853] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:41.656725 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-79dd4d1b-f19b-481e-afcc-90565732bda6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:41.657170 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-79dd4d1b-f19b-481e-afcc-90565732bda6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:41.657958 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-79dd4d1b-f19b-481e-afcc-90565732bda6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:41.658389 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-79dd4d1b-f19b-481e-afcc-90565732bda6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:41.671477 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-79dd4d1b-f19b-481e-afcc-90565732bda6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] HTTP exception thrown: Instance 016c7aa0-86aa-4e90-a0a8-8891c5060853 could not be found. Aug 13 04:40:41.672053 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-79dd4d1b-f19b-481e-afcc-90565732bda6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Returning 404 to user: Instance 016c7aa0-86aa-4e90-a0a8-8891c5060853 could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:40:41.672886 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-79dd4d1b-f19b-481e-afcc-90565732bda6 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853" status: 404 len: 111 microversion: 2.1 time: 0.027496 Aug 13 04:40:41.673406 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 683/1345] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:40:41 2021] GET /compute/v2.1/servers/016c7aa0-86aa-4e90-a0a8-8891c5060853 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:40:44.707205 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-4f485129-5e59-45d3-b442-ba3ac61a7af2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:44.707728 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4f485129-5e59-45d3-b442-ba3ac61a7af2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:44.711286 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-89fb90f9-35b0-4178-abba-a1cbc8d62224 req-a39f9791-4849-48df-a52b-a303ed0ae4f3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06fee77a-c81e-400f-8a01-959a6d472e9c", "tag": "b09d6a5f-8290-4c39-852c-99ab3183d05c"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:40:44.713283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:40:44.713283 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:40:44.713762 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f485129-5e59-45d3-b442-ba3ac61a7af2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:44.714390 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f485129-5e59-45d3-b442-ba3ac61a7af2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:44.715980 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f485129-5e59-45d3-b442-ba3ac61a7af2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:44.716590 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-4f485129-5e59-45d3-b442-ba3ac61a7af2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:44.721986 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-89fb90f9-35b0-4178-abba-a1cbc8d62224 req-a39f9791-4849-48df-a52b-a303ed0ae4f3 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:44.722634 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-89fb90f9-35b0-4178-abba-a1cbc8d62224 req-a39f9791-4849-48df-a52b-a303ed0ae4f3 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:44.734715 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-89fb90f9-35b0-4178-abba-a1cbc8d62224 req-a39f9791-4849-48df-a52b-a303ed0ae4f3 service nova] Creating event network-changed:b09d6a5f-8290-4c39-852c-99ab3183d05c for instance 06fee77a-c81e-400f-8a01-959a6d472e9c on hv-cinder-75996 Aug 13 04:40:44.744205 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-4f485129-5e59-45d3-b442-ba3ac61a7af2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Going to try to terminate instance {{(pid=108288) delete /opt/stack/nova/nova/compute/api.py:2540}} Aug 13 04:40:44.747441 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-89fb90f9-35b0-4178-abba-a1cbc8d62224 req-a39f9791-4849-48df-a52b-a303ed0ae4f3 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039481 Aug 13 04:40:44.748049 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 684/1346] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:40:44 2021] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Aug 13 04:40:44.836592 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-4f485129-5e59-45d3-b442-ba3ac61a7af2 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "DELETE /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 204 len: 0 microversion: 2.1 time: 0.132630 Aug 13 04:40:44.837748 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 663/1347] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:40:44 2021] DELETE /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Aug 13 04:40:44.846702 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-c5253cfd-61f6-42e6-9dcf-3cb01b759614 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:44.847497 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-c5253cfd-61f6-42e6-9dcf-3cb01b759614 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:44.853739 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5253cfd-61f6-42e6-9dcf-3cb01b759614 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:44.854280 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5253cfd-61f6-42e6-9dcf-3cb01b759614 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:44.855137 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5253cfd-61f6-42e6-9dcf-3cb01b759614 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:44.855860 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-c5253cfd-61f6-42e6-9dcf-3cb01b759614 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:44.995263 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.policy [None req-c5253cfd-61f6-42e6-9dcf-3cb01b759614 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108287) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:40:45.003577 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-c5253cfd-61f6-42e6-9dcf-3cb01b759614 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1578 microversion: 2.1 time: 0.160893 Aug 13 04:40:45.004495 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 685/1348] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:40:44 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1578 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:40:46.021702 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-a94fa5a1-8f0f-48f9-a10b-bb0266002e3f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:46.022435 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-a94fa5a1-8f0f-48f9-a10b-bb0266002e3f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:46.029047 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a94fa5a1-8f0f-48f9-a10b-bb0266002e3f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:46.029527 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a94fa5a1-8f0f-48f9-a10b-bb0266002e3f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:46.030300 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a94fa5a1-8f0f-48f9-a10b-bb0266002e3f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:46.030743 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-a94fa5a1-8f0f-48f9-a10b-bb0266002e3f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:46.157978 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-a94fa5a1-8f0f-48f9-a10b-bb0266002e3f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:40:46.165200 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-a94fa5a1-8f0f-48f9-a10b-bb0266002e3f tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1459 microversion: 2.1 time: 0.147573 Aug 13 04:40:46.165779 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 664/1349] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:40:46 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1459 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:40:46.827990 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [req-530beb84-bf28-474b-9f42-3d8cb47cac57 req-a9b17d1e-9931-4f2e-ae7d-40959860ed06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06fee77a-c81e-400f-8a01-959a6d472e9c", "name": "network-vif-deleted", "tag": "b09d6a5f-8290-4c39-852c-99ab3183d05c"}]} {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Aug 13 04:40:46.829731 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1064: UserWarning: Policy os_compute_api:os-server-external-events:create failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 13 04:40:46.829731 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: warnings.warn(msg) Aug 13 04:40:46.836744 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-530beb84-bf28-474b-9f42-3d8cb47cac57 req-a9b17d1e-9931-4f2e-ae7d-40959860ed06 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:46.837192 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [req-530beb84-bf28-474b-9f42-3d8cb47cac57 req-a9b17d1e-9931-4f2e-ae7d-40959860ed06 service nova] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:46.848926 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.compute.server_external_events [req-530beb84-bf28-474b-9f42-3d8cb47cac57 req-a9b17d1e-9931-4f2e-ae7d-40959860ed06 service nova] Creating event network-vif-deleted:b09d6a5f-8290-4c39-852c-99ab3183d05c for instance 06fee77a-c81e-400f-8a01-959a6d472e9c on hv-cinder-75996 Aug 13 04:40:46.853672 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [req-530beb84-bf28-474b-9f42-3d8cb47cac57 req-a9b17d1e-9931-4f2e-ae7d-40959860ed06 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029794 Aug 13 04:40:46.854313 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 686/1350] 10.222.0.13 () {64 vars in 1318 bytes} [Fri Aug 13 04:40:46 2021] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Aug 13 04:40:47.181404 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:47.182042 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:47.188361 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:47.188807 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:47.189605 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:47.190034 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:47.222096 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:47.222534 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:47.222976 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.objects.instance [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lazy-loading 'fault' on Instance uuid 06fee77a-c81e-400f-8a01-959a6d472e9c {{(pid=108288) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Aug 13 04:40:47.261266 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.policy [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3abce7098260457cad30873156a242d0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6f2d284955ea4d12b60ceba4f7a53e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=108288) authorize /opt/stack/nova/nova/policy.py:199}} Aug 13 04:40:47.269036 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-7a825b66-1242-4b27-83be-e3e8e0ef21b3 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 200 len: 1231 microversion: 2.1 time: 0.091323 Aug 13 04:40:47.269629 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 665/1351] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:40:47 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 1231 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Aug 13 04:40:48.287006 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4d448ea4-e30d-42a6-b99b-7a8ee105ec19 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:48.287640 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-4d448ea4-e30d-42a6-b99b-7a8ee105ec19 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 06fee77a-c81e-400f-8a01-959a6d472e9c] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:48.294411 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4d448ea4-e30d-42a6-b99b-7a8ee105ec19 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:48.294861 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4d448ea4-e30d-42a6-b99b-7a8ee105ec19 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:48.295626 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4d448ea4-e30d-42a6-b99b-7a8ee105ec19 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:48.296065 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-4d448ea4-e30d-42a6-b99b-7a8ee105ec19 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:48.311345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-4d448ea4-e30d-42a6-b99b-7a8ee105ec19 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] HTTP exception thrown: Instance 06fee77a-c81e-400f-8a01-959a6d472e9c could not be found. Aug 13 04:40:48.311345 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-4d448ea4-e30d-42a6-b99b-7a8ee105ec19 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Returning 404 to user: Instance 06fee77a-c81e-400f-8a01-959a6d472e9c could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:40:48.312212 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-4d448ea4-e30d-42a6-b99b-7a8ee105ec19 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c" status: 404 len: 111 microversion: 2.1 time: 0.029364 Aug 13 04:40:48.313074 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 687/1352] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:40:48 2021] GET /compute/v2.1/servers/06fee77a-c81e-400f-8a01-959a6d472e9c => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:40:48.807152 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-591ec922-c53f-4743-b2f7-c7f164827cfa tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:48.807694 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.compute.api [None req-591ec922-c53f-4743-b2f7-c7f164827cfa tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108288) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:48.813972 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-591ec922-c53f-4743-b2f7-c7f164827cfa tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:48.814420 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-591ec922-c53f-4743-b2f7-c7f164827cfa tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:48.815191 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-591ec922-c53f-4743-b2f7-c7f164827cfa tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:48.815623 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG oslo_concurrency.lockutils [None req-591ec922-c53f-4743-b2f7-c7f164827cfa tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108288) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:48.829259 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.wsgi [None req-591ec922-c53f-4743-b2f7-c7f164827cfa tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] HTTP exception thrown: Instance 04e0099a-7c38-4609-a63f-fee3baa6db7a could not be found. Aug 13 04:40:48.829902 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-591ec922-c53f-4743-b2f7-c7f164827cfa tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Returning 404 to user: Instance 04e0099a-7c38-4609-a63f-fee3baa6db7a could not be found. {{(pid=108288) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:40:48.830728 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-591ec922-c53f-4743-b2f7-c7f164827cfa tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "DELETE /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 404 len: 111 microversion: 2.1 time: 0.027293 Aug 13 04:40:48.831254 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 666/1353] 10.222.0.13 () {58 vars in 1239 bytes} [Fri Aug 13 04:40:48 2021] DELETE /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:40:48.842241 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ddd27c02-1afb-4312-a569-74779aff9697 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '>' {{(pid=108287) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:48.842881 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.compute.api [None req-ddd27c02-1afb-4312-a569-74779aff9697 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] [instance: 04e0099a-7c38-4609-a63f-fee3baa6db7a] Fetching instance by UUID {{(pid=108287) get /opt/stack/nova/nova/compute/api.py:2791}} Aug 13 04:40:48.848837 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ddd27c02-1afb-4312-a569-74779aff9697 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:48.849285 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ddd27c02-1afb-4312-a569-74779aff9697 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:48.850089 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ddd27c02-1afb-4312-a569-74779aff9697 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:355}} Aug 13 04:40:48.850525 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG oslo_concurrency.lockutils [None req-ddd27c02-1afb-4312-a569-74779aff9697 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Lock "9ad7862d-4e34-4150-8fb8-d2ca44be5989" released by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=108287) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:367}} Aug 13 04:40:48.866645 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.wsgi [None req-ddd27c02-1afb-4312-a569-74779aff9697 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] HTTP exception thrown: Instance 04e0099a-7c38-4609-a63f-fee3baa6db7a could not be found. Aug 13 04:40:48.867427 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: DEBUG nova.api.openstack.wsgi [None req-ddd27c02-1afb-4312-a569-74779aff9697 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Returning 404 to user: Instance 04e0099a-7c38-4609-a63f-fee3baa6db7a could not be found. {{(pid=108287) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:927}} Aug 13 04:40:48.868821 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO nova.api.openstack.requestlog [None req-ddd27c02-1afb-4312-a569-74779aff9697 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a" status: 404 len: 111 microversion: 2.1 time: 0.032531 Aug 13 04:40:48.869760 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: [pid: 108287|app: 0|req: 688/1354] 10.222.0.13 () {58 vars in 1236 bytes} [Fri Aug 13 04:40:48 2021] GET /compute/v2.1/servers/04e0099a-7c38-4609-a63f-fee3baa6db7a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Aug 13 04:40:50.157863 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: DEBUG nova.api.openstack.wsgi [None req-3ac342bf-c9da-4f7d-bfc6-72dc8a228630 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] Calling method '.version_select at 0x7fc46c494160>' {{(pid=108288) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Aug 13 04:40:50.178043 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO nova.api.openstack.requestlog [None req-3ac342bf-c9da-4f7d-bfc6-72dc8a228630 tempest-TestVolumeBootPattern-1171444093 tempest-TestVolumeBootPattern-1171444093-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1602395338" status: 202 len: 0 microversion: 2.1 time: 0.024090 Aug 13 04:40:50.178613 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: [pid: 108288|app: 0|req: 667/1355] 10.222.0.13 () {58 vars in 1263 bytes} [Fri Aug 13 04:40:50 2021] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1602395338 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Aug 13 04:41:31.172133 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 13 04:41:31.172823 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: Fri Aug 13 04:41:31 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 13 04:41:33.341829 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 13 04:41:33.342387 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: Fri Aug 13 04:41:33 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 13 04:43:10.909188 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 13 04:43:10.909912 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: Fri Aug 13 04:43:10 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 13 04:43:24.011189 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 13 04:43:24.011713 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: Fri Aug 13 04:43:24 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 13 04:43:44.353981 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 13 04:43:44.354587 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: Fri Aug 13 04:43:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 13 04:43:44.378065 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 13 04:43:44.378551 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: Fri Aug 13 04:43:44 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 13 04:44:51.191616 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 13 04:44:51.192314 dv-cinder-759961-6-iscsi devstack@n-api.service[108288]: Fri Aug 13 04:44:51 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Aug 13 04:44:53.359497 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Aug 13 04:44:53.360019 dv-cinder-759961-6-iscsi devstack@n-api.service[108287]: Fri Aug 13 04:44:53 2021 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!